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Tho  p''OhnliJ.llty  otruclViro  uf  h-  roul  two-d Imonalonal  statlorv- 
Hry  (  zoro  Kt'mn )  (.lnunaian  vooto.i'  procoos  t  x(  t ) ,  y(  t)  1  o>  <  t  <  oo  , 
is  spodlflod  (  In  aoiciuloly  continuous  cano )  by  ), 

the  spectt’*!-  donn.l.wloM  of  tlu*  x{  t)  and  yl  t)  processbi  roapoc  tlvoly , 
c(\  )  the  coepv'^u  trn].  rlonni  ty  »  ,  bi\d  q(A)  the  quadrtxturo  apfic  c-ral 
density  (-  co-:X;<  05  ).  'fhe  lUssortnti on  trouts  the  proUlbia  of 
Join  tly ,  ea  tiina  t  lin'  ( In  a  auliubie  srnao)  f  _(X),  clX),  qlX) 

from  a  f  ini  In  iH.\r  t  .of  u  nr.mpl  0  futictlon  of  tho[  x(  t)  ,y(  t  )?j-  co  <  t  <  c», 
process.'  K\\  Mppro^lmatloh  to  the  Joint  BUinpIlne;  dlntributlon  of 
thtt  os'timrttbra  for  f,-(X)i  f..^(X),  cCX);  q(>)  In  obtained. This 
approxlir.ato  namp.llivK  dlatrlbdtlcn  tofnod  n  Complex  Wlohai’t  distri¬ 
bution  neryoa  utt  tho  otartlti^  point  In  (ho  derivation  pf  approxi¬ 
mate  sampling  t(t  n  l.r  Ibutlojts  of  estimators  f  or  .  Tunc  b' onn  of 
f_-(X)>  c{\),  q(X).  ..  . 

The  cM  3!  pr  (,»  t.l  on  was  avollvutod  by  tVio  need  of  expcrlmon  tors  l 

In.  fields  augh  an  mt oromotoorology,  oceanography,  oloctrldal 
ervglheorlng ,  and  aoronav.tlcal  engineering  to  st'itlatlcally  oatlmate 
’’parameters"  ohar no. tort  v.l ng  vheir  particular  phynical  oy:itom.a  and 
to  treat  the  si'oii].  ling  varlnMlVly  of  on  tlaiatorni  for  the  ."purnme  ters" .  , 
In  a  number  of  'inrten  tlio  "j-arametera”  to  bo  oritlmntod  are  .  f  utic  tlona 
of  the  der.nlilon  ['  (X),  f’  (\),.c(X),  q(X)  ol‘  «  icol  two-dlmenatonol 

3  ta  t c:vi' ry  (  .'.nro  mi'nn  J  (laussl  an  vector  procona. 
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Chapter  1 

Stati'iT.ont  of  Problem  and  Fionultti 

1,0  Introduction 

Thla  chapter  statoa  the  oa  I  Imotlon  prcbl-oiu  atudled, 
the  r.otlvatlon  for  the  problem,  and  the  roaulta  achieved, 

1.1  ucnornl  Statement  of  Problem  and  Hesulta 


The  probability  atructore  oT  a  real  two-dl.nensloi'.aX 
a  tatlonary  (  zero  moan)  Gauralen  vector  procens  [.’.(t),  y(t)l 
-  <t>  <  t  <  ooj.la  api'clfled  (in  taa  ab^olutoly  oontli.uoua 
caao)  by  tho  apecti'ul  density  /utitrlx 


(l.l)  f(x) 


X) 


X)  X) 


(  -  oj  <  X  <  oo  ) 


where 


r(X)  continuous,  ‘"yy^ '  "  ^yy* * 


^xx^^’  i  0'  fyy(^)  i  0.  X)fy,/  X)  -  |f^y(x)r-'  0. 

In  (1.1) 

f^(  X)  =  spectral  density  of  x(t)  proccca, 

f  (  X)  -  soectml  density  of  y(t)  proceno, 

•  » 

f^_(  X)  =  c(  X)  ■*■  lq(  X)  =  c-  OS3  snee  r  ;  a  1  der.  <itv  of 

A  J  ‘ 


the  x(t)  proceso  with  the  y( t )  preoesa. 


c(X)  “  ciitpocKrttl  donslty  ■  Real  .part  f_^(X)i 
ij(X)  “  qurtdri’t'jr*  epsetral  danslty 
«  In-.aalnary  part  f^y(X)»  • 

Iho  dl asarti.tloii  treats  the  problem  of  Jointly  esti¬ 
mating  e(X),  q(X)  fro.-n  a  finite  part  of  a 

aoiT.ple  function  of  the  fx^t),  y(t)]  procosa.  To  be  more 
precise,  what  Is  ontlmat^d  la  not  the  •spot'*  dermltlea 
f  _<x),  f„_(x),  c{x),  q(x>  but  weighted  Integrals  of  those 
denattleo  where  the  wolghci  ore  such  as  to  concentrate  most 
of  the I'r  "mesa"  In  narrow  frequency  bantls.  Eh.phasls  la 
pieced  on  the  study  cf  the  sampling  variability  of  the  cstl- 
.'..ators.  An  approximation  to  tho  Joint  oiunpllng  distribution 
of  the  estimators  for  f  (X  ) ,  f  (X),  c(a),  q(x  )  Is 

A*  jj 

obt.tlncd.'  This  approximate  campling  c^istrlbutloh  is  termed 
a  Complex  Wlshart  distribution,  uprtaln  distributions 
derived  from  the  Complex  Wlshart  dl ; trlbutlcn  era  cpprcxl- 
natj  sanpllng  distributions  of  estimators  ior  functions  of 
f_-(X},  I'  <X),  c(X),  q(X  1  such  as 


(1,2)  — ■ ,  ;ug  (c+iq),-i^^-i3^, 

f. 


^xx^yy 


XJt 


^xx  ^xx 


and  such  distributions  are  extensively  discussed. 


1,2  Motlvstlon  and  Orientation 


The  dissertation  was  motivated  by  tho  need  of  experi¬ 
menters  In  field.*'  such  as  irilurometeorology ,  oceoncgiv.phy. 


Gausalin  vector  process.  ETa_r.ple3  of  such  functions  of 
physical  slg^ll’lca^ca  are  given  py  (1.2).  To  Illustrate 
this  the  fcllowing  (  sctr.cwha;  artlflcal  and  Ideall/.rd) 
exacT.ple  from  the  theory  of  gravity  waves  Is  given  to  slicw 
how  a  statistical  estimate  of  the  function  Ai g^( c  +  lq  ) 
of  a  suitably  defined  p  'ss  could  serve  as  •  asls  for 
determining  the  physlot:  )nstent  g. 


Goriolder  the  snail  oscillations  of  the  free  aur- 


Ti(L,t)  «  /  8ln(ut-  —  ♦ 

For  a  random  (Independent  phases)  superposition  of  such  progresslre 
wsvas  the  free  curfoee  la  given  by 


[l.S)  n(L,t)  -  /  tc03(ut-  ^)dO{u) 


*  •ln(ut-  — dV ( u>) ) , 


t:(u)  and  V{u)  are  .real  Oauaalan  processes, 

E  qU(u)  -  K  dV(ul  3  0, 

E  du(u)dV(<»')  3  0, 

S  dj(u)d'J(u')  3  0  3  E  dV(w)dV(u')  It 
E  rdC(u)l*  =  EtdV(u)]*  3  s(a))du. 

Toe  representation  (1.5)  servos  as  a  r-.ather.atlcal  r.jJel  for 
what  is  termed  In  oceanography  R  Gaussian  Infinitely  long 
crested  confused  soa.  Consider  now  the  two-dimensional 
p-ocess  rx*(t).  y^(t)}  obtained  by  measuring  the 
hslc-ht  of  the  free  surface  at  two  points  which  are  a  dlt- 
tir.oe  L  apart.  If  there  are  no  errors  cf  measurement, 

Y'C(t)l  Is  a  two -dliiier.s icnal  stationary  (zs^  moan) 

--,4  annr  1  d'T.sltv  matrix  of  this 

Gaussian  process,  and  tne  spec*..-  i  , 

process  Is 

r  -iu“L  1 


( 1 .  o ) 


f  (a>)  = 


®  3  (le) 


S  s(u) 


1 

J  . 


.  • .  • . 
.v.v . 


•  -■  v'-'. 


>  >■'. « . • 
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.••'.■w  .vl-' 


.  '  w"" 

.*  •  _*‘w  -Ni  •”*» 


•  s  t  •  -  . 
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-■Cn-; 


.v‘ .• 


A? 


V  \ 

dl 

t  •  •  ^ 

1^ 


•s'.--' 

-w--. 


■V‘V> 

'v*  *. 

V.'. 


Thus 

(1.7) 


'■xx<“' 

V“> 

c(w)  •♦■  lq(u ) 


J(«) 


a(u  ) 

-m*'L 
>  ®  a(u) 


If,  however,  there  are  errors  a  (  t)  and  e  ( t) 

^  y 

in  treasuring  the  heights  x(  t)  and  y(t)  respectively, 
and  theoo  errors  are  sample  functions  of  stationary  (zero 
mean)  Gaussian  processes  Incoherent  wl  ch  each  other  and 
with  the  randcm  heights  x(t),  y(t),  then  the  spectral 
density  matrix  of  the  process  (  x*(  t ),  -y^C t )  1  Is 


r 


(1.8) 


f*(  u)  « 


.lw**L 


s'U)  3„jj(“) 


8(  W) 


ItfL 


.(u) 


s'  w)  +  3^y('j) 


From  (1.8) 


(1.9) 


Thus , 

(1.10) 


*^(<J) 

“  o(  <j) 

+  3  (U)  , 

ex  ' 

*  (.0) 

=  s  ( u ) 

yy 

ey 

-1  aj“L 

■  («)  + 

lq^(ij)  = 

e  ®  0  (u  ) 

ls(w)3ln!^ 

S 


Aj5  t  c^(u)  lq*(w)l 
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C 


’  ’  •/  •.*  s'* 


S:  V-; 


1 \  v'  . 


^  .  • 


‘h".' 

•  •'  ji^  a  '  a  1 

*  "  »  '  e  • 


.*•  ’**“  ***  ’•"*  ' 

e*  »  '  -**«  ■  *'  'V  ' 

. ^V-W  • 


•  -w  n  •. ' »  •yK, 


‘  •**  *■ 


•V-  *,•*'  *  '  •'■  '  “  •! 

o.*  ■-  i 


and  the  physical  conHant  g  la  given  by 


(1.11) 


ilro'fe  (w) 


lci^(to)  1 


If  /Irg  [0^(01)  •*■  lq*(o)))  la  03tlniat«*d  from  a  finite  length 
of  moasurod  record  7*(t)),  0  ^  t  ^  T»  on  osvlmata 

>f  g  can  be  obtalr.e'.i  by  aubotltutlr.g  this  estimate  for 
Aj-gfo^fM)  +  lq*((-:)l  In  (1.11).  Prom  (I.7)  and  (I.9)  It 
la  seon  that  c  (u)  +  iq  (u)  -  c(e;)  +  iq(w),  so  that  the 
errors  o_(t),  a  (t)  do  not  affect  the  theoretical  cross- 
Si.acti’um.  The  errors  do  not  however  iffoct  the  variability 
of  estimators  for  the  cross-spec  tram.  I'  general,  as 
3^^(to),  a^y(co)  Incroane,  the  length  of  reco 'd  required  to 
estimate  the  croas-spnjtrum  (with  fixed  confidence)  also 
Increases,  The  dissertation  provides  tho  machinery  for 
quantitatively  studyinv  how  the  variability  of  the  ostla.a* 
tors  for  the  spectra  and  eros s-spec ih Jm  and,  what  la  of, 
particular  Interest  In  the  situation  Just  treated,  how  the 
variability  of  the  ostlir.etors  for  Argt  c  “  (w)  +  iq*(u)) 
vary  as  tho  length  of  sample  rccc.a  ^.ncreaaoj. 


Spectral  donsllleo  are  oosentlally  variances  and 
cospoctrel  and  quadrature  ..pectrcl  dsnsitlos  are  essentially 
covariances.  One  can  thus  rlgr.tly  think  of  the  dissertation 
as  dealing  with  a  special  topic  In  the  theoi  j  of  “■measuring'* 
variances  and  covariances,  and  wlvn  relation  of  such 


*i.:oe .‘lur omen 1 3”  to  parameters  rf 


led  slgnificanoo. 


Tha  Idei*  that  phyfl  al  parane '-er 3  can  bo  do ter.i.lnod  by 
"maHMMr'lnc'**  "arlarirtoa  or  moon  oq'j''re8  5s  not  new.  One 
oltolna  thr  corroat  orlontfttlon  by  conn Idorlr. tr.e  follow¬ 
ing  clonaloal  oxuaplo  from  the  Unetic  theory  cf  mioses 
whore  tha  molecular  origin  of  Brownian  motion  was  ccnllrmed 
by  the  quontl to tl ve  agreement  of  the  reasured  displacements 
of  Brownian  notion  particles  In  a  given  time  with  the  pre- 
fMo ttd  vr.lua  of  such  displacement  baaed  on  tha  theory  of 
Elnatoin  and  von  Smoluchowslcl .  According  to  the  'reory  of 
Eliiscoln  ntiJ  von  Snoluohowakl 


O  .12) 


where 


a 

neanX(t)  = 


X(  t)  »  the  X  component  of  dlsplaccncnt  of  a  orcwnloJi 
notion  particle  In  time  t,  and 

-  the  gas  constant, 

T  =  the  absolute  temperature, 

=  ch«  Avogadro  number, 

>1  =  the  coefficient  of  visouaity  of  the  liquid, 

a  =  the  radius  of  ‘•he  particle. 

J.  Perrin  made  re jsurements  of  the  x-ec.-.p'-r.e.'. c  of  dlsplace- 

r.ent  of  a  particle  in  time  t  ur.d  ccr.pute"’  ar.  overage 

a 

X  (t)  from  these  mcocurer.en  ts  which  -uac  In  nmree.-.e.'.  t  with 
ti.e  value  giver'  tv  (1,12)  with  the  co.-.  c  tr.n  tc  ,  h,  'r,n,'l 

rt  <v  I 

-  7  - 
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dotcrmined  from  other  o^j'f.rlir.eata . . ,  S'.ioh  mououremonts  also 

served  as  a  basis  for  determining  the  Avogedro  number 

when  the  constants  R^,  T,  a,  n  wore  known  from  other  sources 

1.3  Coirr.ents  OP.  the  Contents  of  Chaptora  2-4 

Chapter  2  contains  an  exposltl-n  of  the  probability 
theory  on  which  the  oatlmutlon  problem  Is  based.  The  prin¬ 
cipal  roforonces  for  this  n.aterlal  are  (  3l  .  tl5l,Cl61. 

In  Chapter  3  ostlnators  for  the  spectral,  cospcctral, 
and  quadrature  spectral  densities  are  specified  and  studied. 
The  r.otoi'lal  of  this  chapter  extends  the  results  of  Tukey 
(I7I  to  the  two-dimensional  case  and  uses  r.u.ny  of  the  re¬ 
sults  and  ideas  of  Tukoy  t 17J . 

Tho  material  on  the  Complex* Wlihartdlstrlbulloti 
and  related  distributions  which  comprises  Chapter  Is 
believed  new.  The  Complcx-Wlshurt  distribution  ajid  related 
distributions  are  the  distributions  of  the  sample  second 
momenta  of  complex  Gaussioji  random  variables  and  the  distri¬ 
butions  of  curtain  fuiictions  o;’  these  sample  moments  respec¬ 
tively.  Tne  distributions  are  used  tO  study  the  sampling 
variability  of  estimators  for  the  spectral,  cospectral,  snd 
quadrature  spectral  densities,  and  ths  sampling  variability 
of  the  'j'jtlnators  for  functions  of  tb.ese  densities.  Other 
applications  of  these  distributions  m.ay  conceivably  arise, 
and  fer  this  roasen  Chapter  4.  is  so  written  that  it  rr.ay  bo 
road  ■•■'Ithout  referring  to  tb.o  other  chapters. 

-  a  - 


The  ;  .rat  section  of. Chapter  $  contains  a  alscusslcn 

Utl  iiVM  i*nC  hA.«M  •U.*UV,>U 

butlrr.3  are  to  bo  uc'oi.'  to  rftudy  tho  ac-'npl In;;  vcrlablllty  of 
catlir.ators  for  tlio  apootral,  ooapoctrol,  anu  quadrnture 
spoctrai  Jonaltlea  and  functions  of  these  densities.  The 
second  section  Indicates  how  by  using  the  eatlmatlon  theviry 
developed  earlier  the  fre(;uer.oy  response  function  of  a 
linear  tl.T.e  Invariojit  systeia  can  bo  statistically  estimated. 


:^9‘'  ■  •"»# 


■  .  ’  *  "  V  ^ 


Cii>pt<r»  2 

ProbubliiCT  background 

2,0  Introduction 

Thd  probability  gsneralltles  and  details  which 
oonstltuts  tha  background  assontlal  for  an  understanding 
of  the  estimation  problem  treated  In  Chapter  1  are  out- 
llnod  In  this  chapter.  For  the  most  part,  proofs  ere 
omitted,  ' 

2,1  Stochastic  Processes 

A  cne-dlnenslonal  random  variable  X=X(m)  Is 
defined  as  a  real-valued  seasurablo  funotlon  on  a  apace 
tCi  on  which  a  probability  measure  P  is  defined. 
The  apace  J\,  la  called  the  sample  space  end  u  c  J\  la. 
oallod  a  sample  point.  At  times  It  Is  convenient  to  con¬ 
sider  complex-valued  random  variables  Z{u),  and  such 
random  variables  are  cleflnsd  as  Z'a))  ='X(u)  +  iy(u)  where 
X(u)  er.U  Y(u)  are  real-valued  measurable  funstlona, 

A  real  k-dlm.snslonal  random  variable  is  doflned  as  e 
k-tuple  of  real  or.e-dlr.ena lonal  random  variables,  and 
similarly  a  complex  1*.  dlmensloncl  random  variable  la 
defined  as  a  k-tuple  of  complox  one-dlmenalonal  random 
varlablaa,  The  notion  random  variable  now  Ir.oiudes  any 
of  the  apeclllc  types  of  random  vcrlublea  described  above, 

-  10  - 
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,  A  atcchastlo  proodsa  S.«X^(w),t  c  T  Is  an  Indaxad 
oT  raridom  varlaVlas  MArfnad  on  t.ha  , 

(As  1*  custorapy  with  randcn  virlablaa  explicit  rararsno* 
to  the  sacipla  spaca  S\'  la  us-ixlly  not  .xade) .  If  the 
rando.“  virlehlos  fti's  raal  (ccir.plax)  the  procoss  is 

said  to  be  real  (oomplax);  If  the  random  variables 
are  ’•c-dlrunalonal,  the  process  Is  said  to  be  k-dlnenalonal. 
A  k-dlsens lonai  prooasa  (k  >2)  Is  raforrad  to  as  a 
•sartor  process.  In  this  paper  oor.slderatlcn  will  be 
llr-lted  to  prlriarlly  one  and  tvo-dlrr.enslonaL  processes > 

The  Index  set  T  is  usually  asiiuned  t-  'Inlte. 

The  Index  set  may,  for  example,  be  the  continuous  real 
line  tt;  -oo  <  t  <  oo 1 .  In  such  a  case  the  process  is 
said  to  be  a  contl nuouc  parameter  or  >cea3.  The  index 
set  r.aT  on  the  other  htnd  be  a  ilscrate  sot  of  points 
such  as  the  sot  tkdt;k=i. . . , -1,0, 1,2, . . .  J .  In  such  a 
case  the  process  Is  said  to  bo  a  dlsere te  peraweter 
process.  Tno  Index  sat  T  nay  be  quite  general  and  In 
physically  ralavont  situations  Index  sets  7  consisting 
of  n-dlnenslnnal  vector  spaces  ^usually  for  n=>l,2,3,U) 
have  frequently  been  employed.  ?cr  the  purpose  of  the 
present  paper  It  will  suffice  to  restrict  T  to  bo  the 
real  line  t t;  -oo  <  t  <  oo 1  or  the  equlspaced  discrete 
subset  C xdt ;k3 . . . , -1 , 0 , 1 , . . . ]  of  the  real  line.  The 
rsTA-'-itar  t  In  meny  physlci;!  roijresents  time 

and  it  has  becomo  customary  to  refer  to  stocl-.ai'tlc  pi-o- 
cosses  indexed  by  time  as  T*. xe  f-erlas. 
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2.2  atatlontry  Proo«aa6i 

Consldftr  a  k-dlmenaional  oon.'^lex-valuad  prooaaa 
Xt"A^(u),5  »  T,  wha^'a  T  i.ow  dsr.stii  altha.r  tha  oon- 
tlnuoua  group  tt;-oo  <  t  <  ocl  or  tl;#  dlaorat*  group 
I  kAt;l{-». . , , -1,0,1,  . . ,  ]  uharo  In  both  caaaa  addition  la  th* 
group  oparatlon.  Lat  A  dancta  any  r.oaaurablo  aa'o 
K  <  Cl  daftnad  by  a  oonatralnt  on  tha  r.*r.dom  varlablaa 
X^,t  e  T,  l.a.  A»'CLx^,t  e  t].  Lat  danota  tha  aat 
t  t1  whara  -t  <!  T.  Tha  prooaaa  X^,t  i  T  la 
aald  t6  ba  atrlotly  stationary  or  atron;;ly  stationary  If 
P(A)-?(A^)  for  all  't  e  T  and  all  tnaasurabla  asta 
K  <  n,  Tha  moaning  of  tha  last  statsxant  la  that  tha 
probability  stimotura  of  a  continuous  ( dl sorata)  strlo tly 
stationary  prooaas  la  Invariant  undar  tha  group  of  con¬ 
tinuous  (dlsopata)  translations. 

Assume  furtharmora  that  tha  prooaas  x^,t  e  X  la 
such  that  tha  maan  valuas 

(2.1)  B 
and  oovarlancao 

(2.2)  S  (X,-u^)’ Oq^^U^)  -  Coy  (X,,X^)  -  R,^t 

axlet  and  ax-a  flnlto  for  avary  s,t  t  T,  Kara  X..  (for 
ilxad  t)  danotaa  a  k-dlmanslonal  row  vaotor  of  ocitplax 
random  variables  und  danotoa  the  oon'jugata  transpose 

of  X^.  Tha  function  ^  is  (k  x  k)  matrix  valued  and 
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on  [Xtl  can  ba  Inti'odaead  by  praacrlblng  a  mutually  coa- 

••  •  .  ' 

Mla.fcuni.  ublluotloii  of  ..'ini t«  dimensional  dlatrlbutlona. 

Die  conolater.cy  conditions  called  the  cons i a tenoy  eondi t iona 
!1£  Kolir.oKorov  ara: 

(2,5»1)  every  Fj^  is  ajrr.otrlc  in  all  pairs  and 

.  ^  for  J  <  Ic.  . 

The  flnlto  dimona! coal  distributions  ara  thus  basic  uls-- 
tributlaris  of  n  prooesa  and  prcceaaos  are  ^oquontly 
t le.ia! fled  according  t.c  their  finite  dlmenalonal  distribu¬ 
tions.  If  a  prcces.s  is  strongly  stationary 

(d.6)  ** 

"  ^k' '  ^2 *••••*  » '^l*^ ' '•*•» ‘k'*''' ^ 

for  ovary  t,  k  -  1,2,1^....,  , 

A  stochastlo  process  is  cailad  riausalan  if  the  joint  dis¬ 
tribution  cf  every  finite  sot  of  ^  multivariate 
G-iusslan,  that  Is,  fer  every  finite  set  of  tj^,  t2, . . . ,  tj^  e  f 

the  Joint  distribution  of  X,  ,X.  has  the  character 

'^2 

lsi.5.c  fiino felon 


.<.v 

.'■iV, 

9^i 


See  Ch»,pr,e.-a  1,11  of  (  i]  for  the  Lec!:.''.lCal  uatallj  of 
cor.at.ructlng  the  probaoillty  .-r.easura  P. 


-  \U  - 


(2-7)  Bdxpll  1 

'  “ni  w  tt 

-axpt-irt  U  ^  ^  ^  ^ 

Pi  ^  ^ 


Kh*?r4 


(1)  In  the  one-dlmonalonal  oaa« 


X^.^  -  (X^^,  ...... Xj.^1  , 


E  X  -  P(t),  * 


K'  ‘w--''‘h' 

=*  Oov(X^^  ,X^  )  i 

”  ■  *  m  n  . 

(2)  In  tha  twp-dlmenalonal  casa 


=»  (x^j 

>^t 

1 

^*’xt 

.r 

1 

R(t  ,t„)  a  Cov(X^  ,Xj^  ) 


’'t  '^t  *  ' 

'n 


"xt.'Vn'  ’ 


R  (t  ,t  )  R  (t  ,t  ) 

vx'  n  n'  yy  ^  n 
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P  ^  ^  44A»iWi4  m 


In  althor  caad  tha  matrix  )  ]  la  symmetric  and 

n  li  ^  ■ 

non-negative  definite.  If  the  matrix 

non-singular,  the  Joint  distribution  of  -|i(  t, ) .  •  •  ,X.  -jA(t„) 

.  .  ti  1  -  tj,  -  w  ■ 

has  the  probability  density  function 

'  (  fc  4.  \  i  -1 

'^•8),  ’’'VV  !i 

v.’hero  |R(t  ,U  )!  donotoo  the  dotormlnant  of  '-Rt  t  .  land 


(1)  In  the  ono-dlmenalonal  case  (kal) 


end  (2)  In  the  two-dimensional  case  {k=:2) 


2,li  V/eskly  Stationary  Rroeeases 

2 . li .  1  The  continuous  parameter  reax  one-dlmonslonal 
rrccess ■ 

The  process  X^,t  c  T  la  assumed  to  have 
mean  p  a  0.  The  covariance  function  E  la 

assumed  continuous  at  t  a  0,  so  that  It  la  then  bounded 
end  everywhere  continuous.  The  function  Is  even  and 

posltlvo  definite  and  hence  the  To’urier  cosine  transform  of 
a  real  bounded  monotone  non-decreasing  function  F(\) 
called  the  s;:ie-;trnl  fune tlon  of  the  procoji. 


T.  •  .  C.  . 
.  •  ■  •  .  '  1,  .  ,  » 

I . 

>. -h. 

4  •*.  «  . 

*  •  *  .  •  4  ♦ 


r 


:v:“-:Xv;vSo 
*.  •.*  “%■' 
C--..  •■-V'. 

V. 


'v  v*v" 

^  •.  ••  •  *■  •.  *•  * 


•  ’  \*  s"  s’*  •. 


.  -X  »'• 


•>  9-«». 


(2.9)  w,  ■  /  oos  aX  dP(\) 

*.  0.  ,. 

Th«  spectral  funotlori  F(X)  car.  .  exprcaaad  as  th#  sum 
of  three  monotone  non-deoresalng  functions 

(2.10)  F(xj  -  P(,)(:0  +  *  *'(8)^'•^ 


(a)  Pj^(X)  Is  the  absolutely  continuous  component; 
'  X 

P  (X)  *  /  f(x)dx  where  f(x)  >  0  , 

.  la)  Q 

(d)  FglX)  la  the  dlscontlr.uous  componant; 


^(d)  Pr 


whore  X^  denotes  the,  at  moat,  danurcorable 
number  of  discontinuities  of  P(X)  and  p^, 
denotes  the  aaltus  of  P(X)  at  X  ^ 

(a)  P  (X)  la  the  singular  ocmponont; 

8  . 

P,  >(X)  la  everywhere  continuous  and  has  a 
I  a  J 

derlvatl^o  equal  to  zero  almost  everywhere, 
■fhe  case  of  physical  Interest  la  that  In  which  P(X)  la 
absolutely  continuous  with  a  continuous  derivative. 
Unless  otherwise  apoclfled  It  is  assumed  that 


P(X)  ■  /  f(x)dx  where  f  >  0  and  continuous. 
0 
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"  "l  •'*  '' 
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Th«  function  f(X)  la  called  the  apaotral  density  of  the 

proceas»  FVom  (2»9)» 

'  »  ’■  oo 

E  X.  a  R(0)  a  /  f(X)dX  . 

'  0  ,  ,  ■ 

The  proueaa  X^,t  2  T  can  be  oxprassed  In  the  canonical 
foi*n  ( apoo  bral  ropr*oaonna  M  on  of  the  procoas) 
oo  oo 

(2.11)  ^  tXdD(X)  +  /  Bin  tXdV(X) 

where  0(X)  lind  V(X)  are  real  procosaoa  with  orthogonal 
Incronienta  and  the  proceasea  U(X)  and  V(X)  are  ortho¬ 
gonal  to  each  otharj  that  la, 

E  dU(X)dU(x‘)  rT  0  =  E  dV(X)dV(X*)  If  X  x', 

(2.12)  E  dU(X)dV(x')  =■  0  for  all  , 

S  dU(X)  -  E  dV(X)  «  0 

Purtliennore, 

12,13>  E  IdU(X)}*  a  S  IdV(X))*  »  dF(X)  »  f(X)dX. 

The  Integrala  appearing  In  (2.11)  are  atochaa tic  Integrals 
An  Integral  such  as 
b 

(2. lb)  lay  g(X)dU(X)  (6(^)  real  and  continuous) 

a  .  ■ 

la  Introduced  as  followa: 

Consider  a  sequence  of  random  variables  Ig, . 
defined  by 


(2.22) 


i  <»*  »  ~  '’x  «y  • 

V  * 

-°x  ®y  •  l«Ty<'^‘  -®y  * 


Th*  oovarlana*  functions  «■«  b*  «x- 

AA  *y  y*  /y 

prosssd  In  thd  form 


(2.23.1)  R-j-i-t)  -/  cos  XX  <iP,_(X)  , 


(2.23.2)  R,,(t)  -  ?.^(-x)  »/  cos  xX  dG{>.) 

*y  y*  Q 


+  /  sin  XX  OiiiX)  , 

0 

oo 

(2.23.3)  R_(^)  “/  cos  xX  dF  (X)  . 

yy  0  ^ 

The  functions  Pjm(X),P^(X),C(X),Q(X)  srs  r«sl  runctlons 
of  bovindod  variation  In  (0  <  X  <  oo).  Tha  functions 
R'jm(X)  and  sosetral  functions  of  tha  processes 

^■•^P^ctlvely.  The  function  C(>.)  Is  called 
the  coapeetral  function  and  the  Tanctloa  ^(l)  the  quad¬ 
rature  spectral  fun; tion.  These  spectral  rur.stlons  satis¬ 
fy  the  fcllowlng  Inequalities  called  Cohsrer.c-y  Conditlonst 


For  ev 


(2.2U) 


where 


ery  (X^,X2),  0  <‘Xj^  '  >2  . 
(AC)"  +  (AQ)*  <  (A?„)(AF„) 

AA  J  W 


AC(X)  -  C(Xj,)  -  C(X^)  et:. 


^  1^9^  r-  W 

«  T  O  »  '  a 

N.  O  s  "  t.  •  V  •*. 

•  o:-y-  •“o 

■U-mv--'  /A<-- .•»,■■  >.iA 

'."V  ’  •  '  * 


/* 


.V  .•»  */  %“  s*  •. 

.•W  „N  'e  ^•S.  •. 

' —  •**-  ■•*.  ‘  »*_  .  W*_ 


*.  s  %  s 


'•‘v  **•  **-  '  •  ' 

S,  *  *,• 


®  (aw* 


.  .  . 


(ji.28) 


I«  f3ty(X)  -  -la  r,y(-X)  . 


IrVorn  (2 1 27)  Cina  obtaLna 


(2.29)  \y(r)  -  /  eoa  tX  Ra  f  (X)dX  +  /  sin  tX  la  f  (X)dX  , 

*  ~oo 

whloh  by  vlrtua  of  (2.28)  raducaa  to  (2.23.2)  with 
o(X)  -  2  Pa  f_„(X)  and  q(X)  -  2  la  f,.(X)  . 

.  A  raal  two-dlaanalonal  prooaaa  aatlafylng  tha  oon- 
tlnulty  oondltlona  (2.21)  can  ba  axpraaaad  In  tha  car.or.lcal 
form  (real  apaotral  rapraaantatlon) 


00  00  ' 

X.  -  /  ooa  U  dU_(X)  ♦  /  Bin  tX  dV,(X) 
0  *  0  . 


(2.30) 


y^  ■  /  ooa  tX  dU  (X)  +  /  aln  tX  dV  (X) 

0  »  0  7 

whara  U^(X),  V^(X),  ^^(X),  V^(\)  ara  raal  proceaaat  sat- 
lafylng  tha  following  ralationai 

(2,31)  B  dUjj(X)  ■  3  dY^(X)  •  S  dU  (X)  «  S  dV  (X)  ■  0  . 
(2.32.1)  II  dU^(X)d:r^(x') 

,  0  if  X  y  x* 

-  S  dV  (X]dV  (X  )  - 

dF  (X)  -  *-  (X)dX  If  X  -  X*  . 


'J-  "  »  u  *  1.  rfj,  •  . 

.  *  *  't**!**'*  * 

•  •  '  •  •  ^  ’  ■  >  ■  ‘ 

.  /  ^  N  . 

,  ^''s'  .• 

^.-V  W. 


L,.;# 

-.\V. 
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•  .•  Ji  ‘  •  "  a'*  a  • 

O' o.;-v 

A  ' 

o-S-;: 


yy  y-;yv- 

‘•  V»  w'-*  *-  V' 


*  «  •  -  •  ■  '  .  '  •  *  *  ’‘a  *  «  V»  ’ 

**  .  ‘  ,  •  «  •  a.  *  a*  a 

^  a  •  a^  .  *  «  »  >  » 


(2.32.2) 


E  dU,(X)dO  (X  ) 
y  •  y 


To  If  X 

'  {X)dv  (x')  - 

^  dF  (X)  -  f 

L"yT  '  77 


(X)dX  If  X  «  X  . 


(2.32.5) 


(2.32.1i) 


E  dVjj(X)dVjj(x')  -  E  dtJy(X)dVy(x')  -  0  . 


E  dU  (X)dU  (X  ) 

X 


-  E  dV^(/v)dV  (X  )  • 


"O  If  X  X' 

_dC(\)  -  o(X) 


(2.32.5) 


(2.32.6) 


(X)d\  it  \  n  X 


E  dU^(X)dV  (X  )  - 

dCi(X)  ■  q(X)dX  If  X  »  x’  . 


b  if  X  /  X 


0  if  X  X 


E  dV^(X)dTT  (X  )- 

-dQ(X)  -  -q(X)dX  If  X  -  X*. 


'Xh#  Intograla  appearing  In  (2.30)  ara  atoohastlc  Intagrala, 
The  apeotral  reproasntatioa  (2.30)  exhlblta  the  proooee 
^t^*  t  «  T  as  a  random  ouperpoaltloa 


(2.33) 


dU^(X)  dV^(X)  ooe  tX 


dUy(X)  dVy(X)  J  jsln  tX 


-1 

iiiii 


.  e  .  e  .  *  ,  X..4  ».*  :  :  A  r 

•**  •*-  A  •*.  -»•- 
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.  'k* 
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•  -  .  •  .  -  .  »  •  •  b^  •  a  <  1. 
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•  <«  I A  iwn,  A 
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.  w  «  •»  y  ^  a  ^ 


r«  ■^Cl^ 


of  trlgonomatrlo  funotAons,  Tho  Inoromont* 
dV^(X)  gra  tha  random  amplitudes  of  coh  t\  and  aln  tX 
In  tha  raproeantatlon  of  and  almilarljr  <iny(X)  and 

dV  (X)  ara  tha  random  anplltudaa  of  ooa  tX  and  aln  tX  In 

y 

tha  rapraaantatlon  of  Tha  aquatlona  of  (2.32)  axpraau 

tha  oovarlanoa  ralationa  botwaan  thaaa  random  amplltudaa. 
Ona  obaervaa  that  any  pair  of  random  amplitudes  at 
different  angular  frequenoloa  ara  uncorrelnted.  At  a 
fixed  angular  frequejioy  XjHTj^CXj  and  dVj^(X)  are  un- 
oorrelated  as  ara  dO  (X)  and  dV  (Xj,  and  the  apootral 
density  gives  the  variance  of  dt7^(X)  and 

dV  (X)  and  tha  spectral  tensity  f  (X)dX  glvos  tha 

A  Jr  Jr 

variance  of  dU  (x)  and  dV  (X),  The  cospootral  density 
J  J 

and  quadrature  speotral  density  express  the  povarlancs 
relationships  that  exist  betwson  the  random  amplltudea 
dUjj(X),  dV,.(X)  of  the  x-component  of  the  procosr.  and 
the  random  'mplltudos  dU  (X),  dV  (X)  of  the  y-ccuponent 

y .  y 

of  tha  process,  '^'ho  pair  of  random  amplitudes  dr/^(X), 
dU  (X)  as  well  as  the  pair  dV  (X),  dV  (X)  associate 

y  *  y 

"In-phase"  terms  of  the  representation  (2,30),  l.e. 

»aoh  member  of  tha  first  pair  Is  an  amplitude  of  cos  tX 
end  each  member  of  tha  second  pair  As  an  amplitude  of 
sin  tX.  The  pair  of  random  amplitudes  dU  (X),  dV  (X) 

*  y 

as  well  as  the  pair  dV  (X),  dU  (X)  associate  "In 

*  7 

quadrature"  (l.e,  Tr/2  out  of  phase)  terms  of  the  represents 
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or  008  t\  the  other  ie  en  emplltude  of  sin  tX.  With 
thla  terminology  of  ‘'in-pheee'*  end  "in-quMdreture'^  one  ean 
oonolaily  cixpresa  the  muenlng  of  the  oospeotral  and  quadra 
ture  apeotral  denaltiei.  The  ooepeotral  denalty  e(X)dX 
glvea  the  oovarlanoe  between  two  ’'in-phase*  fandom  anpll*  . 
tudea,  and  the  quadrature  apeotral  denalty  q(X)dX  givee 
(to  within  a  factor  of  t)  the  oovarlanoe  between  two 
"in-quadraturo*  random  amplltudea.  The  diagram  given.  . 
below  aummarlxoa  the  oovarlanoe  relatione* 


If  th»  procdaa  X^.,t  e  T  la  OauasiQrt,  th»  Increnanta 
dtJA\),  dV_(X),  dO,{X),  dV  (X),  (0  <  X  <  oo)  are  Oauaslan 
random  varlablaa  and  the  mean  and  covariance  roletlona 
(2.31)  and  (2,32)  conplately  determine  the  probability 
atruoture  of  thane  i-andom  variables.  Thus,  It  la  seen 
that  any  pair  of  Increments  taa  for  example  dU^(x), 
dVy(X*)l  at  different  angular  frequencies  X,  X  (X  /  X  ) 
are  Independent.  Furthermore,  the  variance  covariance 
matrix  of  t dU^(X) ,  dV, ( X) ,  dU  (X),  dV  (X)T  Is  given  by 
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f^{X) 

0 

c(  X) 

q(x) 

0 

-q(X) 

c(x) 

c{X) 

1 

-q(X) 

0 

Lq(X) 

c(X) 

0 

(2.3U) 


ao  that  and  d7^(X)  are  Independent  as  are 

da^tX)  and  dVy(X). 

4  • 

a,U,3  The  dlacrote  parameter  real  one  dimensional  proce.’<s. 

The  discrete  pai'ameter  weakly  stationary  pro- 
oessea  considered  hero  are  assumed  to  bo  of  the  form 
X.  .,k  3  . . . , -2  , -1 ,0, 1 , 2 , . . . ,  l.e,  discrete  parameter 
proceacos  obtained  by  observing  the  sample  functions  of 
a  weakly  stationary  continuous  parameter  process  t  T 

at  the  discrete  sot  of  tines  t  =  kit,  k  =  1 , 0, 1 . 2 ,  . 

It  Is  assumed  that  E  =  0,  t  c  T.  hot  E  ^kht^O  * 
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Th«  oovarlanot  ■«quftno«  «  k  ■■  •  •  t  •  1*  trAn 

and  povitlvA  d«rinlto  and  henoA 

(2.35)  -/  ooi  kX  dP^^^'(X) 

mRafa  1a  a  rAAl  boundAd  nonotonA  non-dAorAAiing 

funotlon.  Aa  In  tha  oontinuous  parAmatAr  oaaa.  thA  funotlon 
p(dt)^^)  OAllAd  thA  apAOtral  function  of  tha  prooAAA 
and  in  aaaiunod  (util*da  other^iea  apsilfiad)  to  ba  ab- 
AolutAly  nontlnuouA  with  a  oontinuoua  dorlvatlvA  ao''that 

(2.36)  /*  ooA  kX  f^^^^(X)dX  ,  >  0  . 

**0  ^ 

Tha  proflAAfl  ^  ■  ♦..-2, -1,0, 1,2...,  ban  bo  axproAAad 

In  tha  oanonloal  form  (Apaotral  raproAontation)  . 


(2.37) 


t  •  /*  OOA  kX  dO^^*^(X)  ♦  /*  Ain  kX  dV^ 
'***  0  0  , 
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vhara  U'^^MX)  ,VV^*' (X)  i.ra  raal  prcoAAOAA  with  orthogonal 
inoramenta  that  ara  ortho.jonal  to  aaoh  cthar. 

It  la  now  doslrod  to  axpraaa  f^^^^(X)  tha  npootral 
donaltx  of  tha  dloorota  pararaotar  prooaaa  ^  “  •••»-l<0,l. 

In  tarma  of  f(X)  tha  apaotral  danalt^  of  tha  oontinuoua 
paramatar  proooas  X^,t  e  T  from  which  !■  obtalnad. 

For  tha  oontinuoua  ppocoaa 


(2,38)  R(t:)  -  /  ooa  tX  f(X)dX  . 
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Tho  tin*  irtaPTtl  At  li  oallad  th*  impllng  lnt«rr«i  or 
KyQulat  Intarvil  or  Xroulat  tin* .  and  tha  angular  rrirqraanoy 
if/(At)  la  oallad  th«  antUlar  torrisyp  fraquap.oy  or  a^'.^ular 
folding  fregnoncT  or  angular  V*Qulat  fraguanav.  Th* 
angular  fraquanctaa 


(2.1iS) 


1 « a « 


2tT..X  .  2?r»\  .  Utt-V  . 


At 


At 


At 


At 


•'•  If  if  -V 


(0  <  X  *«  it) 

(0  <  .*.  <  TT/At) 


ara  aald  to  tsa  allaraa  of  eaoh  othar,  and  tha  angular* 
fraquancy  xV(dt),(0  <\  i  ”)  i*  oallad  tha  prlr.alitial 
alias.  Tha  raaaon  for  tha  tarm  alias  Is  that  alnuflolLtls  of 
angular  fraquanolas  givan  by  (2,!t5)  ara  Indittinguiaincbla 
whan  obaarvad  at  only  tha  dlsorata  set  of  tlaes 
!cAt,  k  n  ...>1,0,1,...  •  One  obiarvaa  from  (2.liUl  thiat  the 
apaotral  danslty  f^^^^(X*)  of  tha  dlsorate  paraast.rr 
prooaaa  at  X*  is  aisentlally  tha  awn  of  the  apaatraJ. 
dansitlaa  of  the  oontinuous  paranater  praoeii  at  thoJo 
arigular  fraquanola*  ubloh  ara  tha  allaaai  of  x'/(^«)}  « 


'.V. 


3'^ 


ft*:"H  >»i>i 


2iN.I»  Th*  diaerata  para^atar  r<al  two-diir.analonal  prooesa, 
dlaorata  parair.otar  two-almenslonal  procoasaa 
oonsldarad  hara  ara  aasunad  to  fca  of  tha  form  “ 

^kAt^*  ••  •»  !•••  dlacreta  paramatar 

prooaaaaa  obtalnad  by  obaorvlng  tha  sampla  funotlona  of  , 
a  continuous  paranater  proooaa  ^ 

tha  diacrota  aat  of  blmea  t  «  kAt,  k  ■  ...••ItO,!, . . .  . 

It  la  aaauir.ad  that  E  t  e  T4 

Tha  dlaouaaion  of  tha  dlacnatu  jiai’ametar  real 
two-dlmenalonal  procoaa  la  ar.atogouo  to  that  of  tha  con¬ 
tinuous  paramatar  real  two-diu.ar.a ionol  procoaa  given  in 
Section  2,h,2,  Tha  covariance  function 


(2.^6)  R(kAt)  -  E 


®  *t-t-kAt^t  ®  ’'t+kAt^tl 


^  •'^t+kAt*t  ^  yt4-lcAt5’t 


'R^(kAt)  Rjjy(kAt)' 


Purthemore,  R(kAt)  »  R'(-kAt)  . 

The  covariance  function  R(kAt)  can  ba  exprosaod  in  the 
form 

(2.U7)  R(kAt)  =  dr''^'^^(X)  . 
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(2.h3)  -  4  t  fi(kAt)/  dX  . 

k>»-oo  -* 

If  Iw  &baolut«lp  eontlnuoui  and  poaaasaaa  a 


oontlnuoua  derlvatlva. 


(2.ti9)  - 


Ihua, 


d«  -/ 


(2.50)  P(kAt)  -  /*  . 

-*  ■ 

n**  fur.ctlrna  f^'^^(X)  ar#  tha  apeotral  danal- 

tlaa  of  bha  k  ■  •  * «  pt^ocaasaa 

raipeotivaly  and 


(2.51) 


la  tha  cross  epactral  donalty  of  tha  x.  prooasa  with 

t  _ 

tha  y^  process.  The  matrlx-valuad  function  f^^'^^(x) 
la  positive  sfsl-deflnlta,  l.a. 

>  0 

(2.52.2)  r^^hx)  fSi^Kx)  -  |fi:Mx)|*  >  0  . 
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(2.53.1) 


(2.53.2) 


f^^'(X) 


'(-X)  . 


(2.53.3)  f^J'^MX)  =  f^“’(-X). 

Htra.  fii'^Nx)  -  +  t  q^^*^^(X),  l.o. 

*y 

nmllnd  tho  coaooctrttl  density  of  the  dlsoreto  prooeaa 

X,  ....k  =•  ...-1,0,1,....  la  the  real  part  of  the  cross- 
kAt* 

spectral  densl ty  I'xy'"  *3  (X),  called  the 

quadrature  apeotral  density,  la  the  Imaginary  part  of 

^(At)(x).  From  (2.53.3), 


+  1  q^^*^^(X),  1.0.  cV^’^^(X), 


(2.511.1) 


(2.511.2) 


.q<^^^X)  . 


l.e.  the  ooapeotrsl  donalty  o'*'^'(X)  la  an  even  function 
and  the  quadrature  spectral  density  q^^’^^(X)  la  an 
odd  function.  It  la  desired  to  expreae  I’^^^^X), 
f(At)(^)  o^^^^(X),  q'^''^(X)  the  spectral,  cospectral, 

yy 

and  quadrature  spectral  densities  of  the  discrete  para¬ 
meter  process  In  terms  of  ^yy'^^*  '^(X)»  q(X)  ths 

corresponding  spectral  densities  of  the  continuous  parameter 
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prooesa.  Clearly  f;^^'(X)  la  related  to  r^^(X)  land 
Is  relstsd  td  fyy(5^)l  by  ths  roUtion  (2.!iU). 
To  obtain  tbs  r«latlon  botwesn  tha  oospsotr?.!  d>>nsttl«a 
(and  tho  quadrature  spaotral  donsltlsa)  ona  procaada  aa 


follows t 


(2.55)  R„(kAt)  -  /  r„(X)a 


-IkXAt 


o., 

I  / 

m=»-oo  (2m-l)~ 


•IkXAt 


M*  -  00  tt  * 


2mff . ^-IkXAt 


Lat  X  “  XAt.  'Ibua 


(2. $6;  R„(kAt)  =  -  Z  /  f  1  dx' 

'  '  n^-oo  -w  ^  . 

-  z'  •*?  f  fX’+2mTr.  1  _-ikx'.,  ' 
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That  Is,  the  cross-spootral  density  of  tha  discrete  pararaater 


process  la 
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Her®  -If  <  X*  <  Tf  and  la  an  even  funotlon  of 

x'  and  q^^^^(x')  la  an  odd  function  of  x',  slno®  o(X) 
la  avcn  and  q(X)  la  odd.  One  thus  obaorvaa  that  the  co- 
apaotral  density  of  the  dlaorate  process  at 

X*  la  essentially  the  sun  of  the  cospactral  densities  of 

the  Continuous  process  at  the  angular  fi‘oquonclos 

» 

“  . . .  »-l,0,l,  4 ,  A  similar  relation  holds 

for  the  quadrature  spectral  density.  One  often  eonsldeps 
the  domain  of  the  spectral,  cospootral,  and  quadrature 
spectral  densities  to  bo  0  <  X  <  oo  fcr  a  continuous 
procees  and  0  <  X  <  w  for  a  discrete  process.  With  such 
A  convention 

t  I  t  I 

(2.59)  o  (\  )  3  At  ^  }'*'*'*J 


(2.60)  q<'^'^J(x')  -  J-Iq(^)_q(2^)^q{2ll^).q(k^)^,.., 

(0  <  X*  <  tr)  . 

Thus  the  cospectral  density  )  of  the  discrete  process 

f 

at  X  is  essentially  the  cum  of  . the  cospectral  densities  of 


•  ii  wV 

......  - 


i.  «*X  .•  A  “  . 

‘a  -  - 

'-“.‘•V/AV*-*"’.' 


•'Nv 


•wcv:v:vv;:cj 

V'  vi  .■oV.v.-t\.q 

Wllll  iMIj 

»v,  V 

-x 


•r'*- 


"  vVs*  ■  • 


the  ooti^lnuoui  process  over  the  sngulsr  iVequanoles  which 
are  aliases  oT  \  A  similar  relation  holds  fqr  the 

quadrature  spectral  density,  except  that  for  the  quadrature 
spectral  density  certain  tornis  in  the  sum,  namely  those 
corresponding  to  the  allnses  j- m  <*  3,2,.,,  are 

taken  negatively. 

2»h,$  Weakl,/  Stat*  '>nary  Geusalan  Procossas. 

As  wai  seen  In  Section  •'1.3  a  0.':;u»elan  Process 
la  apeciried  by  ;.ta  mean  function  p,(t)  and  Its  covariance 
function  R(t,t  ).  Thus  tt  a  weakly  atatlonary  procfs*  !■ 
OausBlan,  Che  eompiote  probability  structure  of  the  process 
la  apoclflod  by  the  moan  p  and  covariance  function  R('t), 
A  weakly  stailonary  Gaussian  process  la  thus  strongly 
stationary,-  .  - 


and  Quadra buro  Sbcotrtut 


3.0  Introduntton 

In  thlfl  ohnptor  latlmators  for  tha  apaotra,  coapootrum, 
and  quadratura  apaotrun  of  a  two~dlnonadona\  abatlonary  ( saro 
naan)  Oauoaian  vootor  prooaua  era  studied*  The  ootinators  ara 
suoh  that  it  1'*  poaalbla  to  aatabllah  a  ona-to-one  corraapond— 
anoe  batwoan  tha  oatlraatora  and  trljonoinetrlo  polynomlala 
(flltars).  Explicit  expraaalona  for  oartaln  **gof>fi''  flltara 
ara  darlvod  by  making  usa  of  reaulta  contained  In  fl71«  Fur¬ 
ther,  fonrvtlaa  for  the  moana  and  oovarlancas  of  the  ostlmatora 
ara  obtained*  These  formulae  exhibit  tha  means  and  covarlahoea 
of  tha  estimators  as  Integrals  of' products  of  the  trlgonoroatrlo 
polynomials  odsoolated  with  the  estimators  and  functions  da-* 
pandlni,  solely  on  the  spectral,  cospectral,  and  quadratura 
spectral  densities  of  the  profleps.  The  formulae  can  thus  ba 
thought  of  as  speotraa  representations  for  the  means  and  co¬ 
variances  of  tha  estimators,  Finally,  a  heuristic  argument 
is  prsaented  to  obtain  an  approximation  to  the  joint  sampling 
distribution  of  tha  estimators,  • 

,1  The  Estimation  Problem 
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tlna  (uid  then  aetlKatlng  tha  )ipectr*  and  oross  itpactra  of  . 
the  raaultlng  dleerata  paramatar  procaae.  One  haa  to  asauiaa 
that  tha  apeotra  and  croia  apaotra  of  tha  continucua  para- 
natar  process  affectively  vanish  for  oufflolantly  large X(an 
aasvmiptlon  valid  for  physically  relevant  proeeaaea)  and. 

,'.hft  ‘.ha  .. k -a;; i  1  tl^ia  it  Is  eufilclently  email  so  that 

'*allaslr.g*  beecsas  uninportant*  Uith  the  above  rerarka  in  . 
nlnd,  attention  will  henceforth  be  restricted  to  tha  eati» 
aatlan  of  the  spet^tra,  eospoctrua  and  quadrature  epaotru* 
of  a  discrete  parameter  procaaa# 

Per  tha  iika  of  simplicity  tha  following  abbravlatad 
notation  is  introduced.  The  finite  sanipla  of  length  N  from 
a  dlscrata  piranetar  real  tvo-diir.enalonal  atatlonary  (sera 
mean}  Gaussian  vector  process  given  by  (3>l)  simply 
denoted  by  , 

{3*2) 

(At)  (At)  (At) 

Purthenaora,  the  densities  f _  (X),  f  (X),  e  (X), 

yy 

(At) 

and  q  (X)  are  denoted  by  f  (X),  f  (X),  c(X),  end  q{  X) 

*  y 

respectively,  and  the  corresponding  spectral  functions 

(At)  (  At)  (At)  (At) 

^xx  ^yy  ^  ^  Pj^(  X),Py(  X),C(X), 

and  Q(  X)  respectively.  It  is  dosirad  to  In  some  sense  estimate 
the  X  end  y  spectral  densities  r^( X)  and  ry( X),  the 
cospectral  density  c(\),  and  the  q.^*Jraturo  spectral  density 
q(  \)  from  the  sample  (3,2).  What  is  treated  Is  not  the 
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estimation  of  the  densities  f  (X)»  c(\),  q{  X)  but 

Tacher  the  estimation  problem  for  Integrals  of  these  densities 
orer  a  set  of  frequency  bands  ^  “  1*2,...,  I. 

That  la,  the  frequency  do.-culn  0  -  X  -  x  Is  partitioned  into 
n  finite  set  of  frequency  Intervals  ^  ^  "  1,2, 

by  the  partition  0  »  X^  <  X^  Xg  <  4 . .  <  r ,  The  Inte¬ 

grated  densities 

x  . 

(3.3.1)  “i  "  f,(X)dX  * 

X  ' 

(3.3.2)  ?!  "5^  fy{X)dX  =*  Py(X^ 

"x,  ■ 

(3.3.3)  Yj-/*  c{X)dX  -  C(Xj)  -  C(X^_^); 

'  •  ^1-1'  ' 

X.  ^  ' 

(3.3.(v)  ■  q(X)dX  -  <l(X^)  -  <l(X^.j^),  1  »  1,2....,  I, 

1-1 

are  thus  the  pcrameters  which  are  ••o  bo  eetln-.ated.  In  general 
It  la  deelred  that  the  frequency  bands  ^  X  -  X^^  ba 

Bufflolsntly  narrow  so  that  the  Integrals  of  (3.3),  which  apart 
from  constant  factora  are  the  averages  of  the  spectral,  co- 
Bpeot:sl,  and  quadrature  apectral  densities  over  the  frequency 
bands,  Indicate  the  behavior  of  the  respective  densities  la  the 


iWI 


li 

■^1-  r'**' •  **•  ^  ^  - ^  *.x  v».v 


freq'^ency  cknds.  Aa  wHl  be  dlacuaaed  subaeijUAntly  til^ic  width.a 
of  the  frequency  banda  are  dotormlnad  from  abatlatt'cuA'J.  cor.aldor- 
atlona,  for  generally  speaking  as  the  wldtha 

of  the  frequency  bands  decrease,  atatlatlca  serving  [t.a  estlmatora 
for  the  integrals  of  (3*3)  become  loia  reliable,  i.i)»  tbocome 
relatlTaly  sore  biased  or  become  relatively  more  vart.uble.  In 
chu  estiuatiou  pru'uien  to  be  now  treated  the  parti tlmu 
0  =  X^<Xj^<X^<...  is  considered  fixedl  lund  atten¬ 

tion  Is  directed  toward  obtaining  estimators  for  the'  2  inte¬ 
grals  of  {3.3)  in  the  case  when  {3*2)  Is  a  sample  fron  a  Oauaslan 
process.  It  la,  however,  shown  In  Section  3*2  that  uir-blased 
estl  "ors  for  the  Integrals  of  (3.3)  do  not  In  genarnC  exist. 

A  commeat  Is  therefore  Interjected  here  explaining  threl  one 
should  not  too  rigidly  consider  the  Integrals  of  (3,3!})  us  the 
parameters  to  be  estimated,  Jne  can  obtain  unbiased  utri .'.mators 
for  certain  Integrals,  not  the  Integrals  (3.3)  with  r's-rtangular 
kernels,  cut  similar  integrals  with  trigonometric  polyuvomlal 
kernels  of  bounded  degree.  Thus,  the  parameters  that  mctua  lly 
are  estimated  (unblasedly)  are  certain  Integrals  with)  ttulgono- 
matrlc  polynomial  kernels  of  bounded  degree  that  apprcrmlmt te 
the  Integrals  (3*3)»  It  is,  however,  convenient  to  np'inuk  of 
estimating  the  Integrals  (3.3)»  and  this  will  be  done  tittrough- 
out.  The  preceding  remarks  are  somuwhat  anticipatory  lund  will 
b-eoome  clearer  after  one  has  read  Sections  3.2  and  3-3> 
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3 


1,2  Tha  Esblmtttora 

‘fha  fof  tho  Y^*  \<  ^  I» 

ira  obtained  as  followas 
jflt 


^0  “  i  (Xj^  +  xg  +  ...  ■*■ 

°  .  M  - 


I  -  —  Uj.  *2  •*;  *2  *3  ^  ••*  *  *N-1 

♦  x,  x,iv,  •••  ...  *n-h 


(3.4) 


<*l  *l+h  ^  *2  *2>h 


^-1  ■  *1 

and  take  aa  a  elaia  of  aatlnatora  for  tha  I  -  1,2 . I 

iho  qoadratlo  forma 


(3.5) 


similarly,  let 


*■  ^  ^  ••*  *  ^N“l*  ^  "  1/2, ...,*( 


(3.6)  ^  <^1  ^l+h  ^2  ^a+h  ^  •••  *  ^N-h  ^N), 

"  N-h  . 


If  2f  9  *  *  $ 


and  take  as  a  claaa  of  estimators  for  the  B^,  1  =  1,2,...,  I 


the  quadratic  forms 


(1)  (1)  (1)  „  ,  ,5  T 

(3.7)  Qfl  “  ^0  Pq  *  ^1  ®1  ■*■•••*  ^N-1  ®N-1,^  ” 


•  •/  s,* 


V. 


■-■.N'.--  'i 


mm 


*•  ..V  ,*• , 

.'-'a*.'-  , 


/• 


Thara  now  rormlns  tha  pnoblam  of  how  to  ohoosa  tha 


oonatanta 


(1)  Al) 

0  *  *1  , 

.(1) 

*  '  *  *  M-l 

,(1) 

0  '  » 

•••»  “n-1 

(1)  jiy 

e<*> 

0  *  ®i  * 

•••»  “N-1 

“1  * 

...i 

3.1Z1 


rll  ^  '  1  ■<  1  3  T 

BO  that  "good"  er.tlraatora  for  tha  (  ,Y^  »0j^ )  • 

are  obtained.  It  would  be  deBlrabla  to  ohoooe  the  oonatanta 
( 3«12)  80. that 

(3.13)  E  o^;  B  p^:  K  y^:  B  Oj. 

Unf ortunataly,  as  will  ba  aean  bf  (3.2^)  and  (3.28/  thara  la 

no  choice  of  tha  constants  (3.12)  that  icakas  this  posalbla* 

In  order  to  obtain  certain  simple  and  useful  axprasa- 

lons  for  tho  azpaotatlona  Ed.  jB  dri  d.  i  l^l.T . » . .  .1. 

*1  ■*! 

sxpraBsloni  whloh  will  faollltate  salaotin^'  the  constants  (3.12). 
It  Is  first  naceisary  to  aotibllsh  the  following  formulaat 

(3.14.1)  B  *T<^c*h 
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^  V  *.  ’S  ’  V  .  »  -  .  . 

.  .  *  .  ^  •  W  *  “-Jl  •  *  "  •  . 


jft  V%  •  a  .«  L.t.u  «  - 


. V- ‘ w* .  •  ..■•• 

j.-'''-'!  *«  ■•'.■•’/.  S’l'- 

‘  ‘  •  ’  *.*  V 


I  i.( 


a  •  •  ‘.a  'j  ,»  .•  •*  a'  •  m 

•  C  \  ,*!  /- 

IP  *  ai .  m » 


v*. 


1 


(3.22.3)  E  »/  ooa  Xh  c(X)<lV, 


t3.22.l|.)  E  D.  »  /  sin  Xh  <i(X)dX. 

■  "  -X 


Thus, 


H-1 


(3.23)  E  -  E  2  /'co» 

h-0  ^  ^  h-0  ^  -X 


K-1 


(1)  A 


X  K-1 


-/  (2  sf^’oos  >.h)  f,(X)dX. 
-X  h-0  “  * 


Thus , 


(3.23.I)  E  Cl„  “/  (XjdX  whsr* 

“l  -X  *  * 


ooa  >h. 

•  h-3  “ 


Slnllarly, 

( 3.23.5) 


s  “/  p^^  N  x)f^(  x)dx  whara 


.(1), 


N-1 


Ph*'(  X)  -  2  b!,^^  coa  Xh. 

h-0  ^ 


X  ( 1 ) 

(3.23.3)  ^  "/  ( ^)  clX)dX  whera 

^1  -X  ° 


?[^h  X)  coa  Xh. 

®  h*0  ” 
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*  .  MwiJIKii  ■•Am'.  t*m'  .  ««  na^tr*-**  «*«•>••  V'*  ••«W«ofe>>  m>  *T  ‘4 


(3.23.'t)  E  Qg  =  /  P^*>(X)  q(X)dX  when* 

1  -X 


i*!  .;*.'  ; 


•.  •  -  •  \ 

;  •/ 


X)  »“l  sin  XJi. 

Thd  equations  (3«23)  aJ*8  to  be  considered  as  spectral 
representations  for  the  expectation  of  the  quadratic  and  bi¬ 
linear  fcrr.s  introduced  as  estimatora.  For  oxeor.ple,  consider 
equation  (3.23. U),  One  observes  from  equation  {3.11)  defining 
t“«  and  equation  (3»23.!il  defining  the  X)  that  there 

Is  4  one-to-one  correspondence  between  the  quadratic  forma 

and  the  trigonometric  polynomlalo  P^^^(X),  each  being  deter¬ 
mined  by  the  constants  d[^^,  Furthermore, 

the  expectation  of  the. quadratic  form  Is  very  simply  ex¬ 
pressed  In  terms  of  the  associated  trigonometric  polynomial 
being  an  Integral  of  the  product  of  p|j^^(X)  and  the 

quadrature-spectral  density  q(X).  similar  comments  hold  for 
the  forms  -heir  associated  trigonometric 

polynomials  P^^^X),  P^^^X)  respectively.  From 

equations  (3.23)  ono  gains  some  Insight  on  how  to  choose  the 
constants  {3»12)  or  equivalently  the  trigonometric  polynomials 
^a  ^  '  ^’b  p|j^^(X),  1=1,  ...,  I.  Take  as 

a  typical  case  the  problem  of  how  to  choose  P^^^(X)  so  as  to 

estimate  fl  ,  From  (3.3.4),  0  ^  q(X)dX  and  0  <  X.  ,  <  X.  <  x , 


k  - 


•  •>  * 

•  r  «  •  '4. 

■yV- 


.>a  '- 


I 

N''. 

.y- 

v.'‘% 

I 


S: 


■i'- 


-A 


\< 


m 

^ 

<. 

V. 


N-l 


.ii) 


trlgonom-trlo  polyhcailml  of  tha  fora  Z  Pi“  coa  Xh.  Thua, 

h»0  *‘  ■ 

In  canar*"- ,  V.hn  Q  ,  >A.  ,0  ara  biased  aatlEatora  for 
;  *1  ‘’i  . 

®i*  ^1'  ''^1 


■■ 

I  ■  ■  ■  '  ■ 

;%.■ . . 

i  S,  *  S’. 

■  :■ 

.i-  .  ■  ■ 

A.V 

abl estimators  f 

1' 

p  ■  . 

I  the  trigonometric 

i' ' 

P^^^X),  1=1,  .  .. 

i 

it  ' 

functions  {3,26) 

Ions  for  certain 

.(1). 


,u), 


Soctlon  3»5* 

3,14.  Variances  and  CoTarlances  of  the  Estigatora 

In  addition  to  the  criterion  of  unbiasedness  dis¬ 
cussed  In  Soctlon  3»?.  the  following  should  also  bo  consid¬ 
ered  aa  Ideal  criteria  la  selecting  the  esrlKators  Q  >  Q„  * 

*^1  ^1 

Q  •  Q«  f  1*1 »2j  ••••  Xi 
^11 

(a)  r.lnlrcuK  variability  -  l.e.,  the  variability 

of  the  estimators  Q.  ,  ,  Q  #  >3.  .  1=1,2 . 1  should  be 

Pi  V|  Oj 

a  minimum,  and 

(b)  no  oovariac.- 11  ly  botwee:-.  eseixaters  pertaining 

-  ni  - 


’•  **.  '*•»  •*.  '*  **• 

■  V  ,• 


»■  .•'•V- 


■  •  W  '■  4  “  ■  '  »  ‘  ‘  *-•  *  ,  ^ 

•-  Kr 


1  .V.-. 


.‘•V  ■  ■  ■ 


v< 

V'  ■  ■ 

S:i: 

i'-"' 

ft.  .' 

I 


to  dlfforont  fpequancy  bands  •  l.e.,  the  estlmatoro  $  ^1* 

S  *  %  *  Z"**  S'‘  S'  ^  ^  ^  ' 

Indopsndsat* 

In  order  to  Investigate  the  variability  and  covari- 

ability  of  ,  Qrt  ,  ,  <1.  ,  l“l,2»  ..,,1  It  Is  necessary 

®1  ^1  -1 

to  establish  formulae  for  the  varlanoes  and  covariances  of 

these  estimators.  It  would  be  deairablo  to  have  Tormulae  for 

these  vsi-larces  and  covariances  similar  to  the  spectral  repre*- 

sentaMcn  formulae  (3*23)  for  the  expectations,  ae  such  spectral 

representation  formulae  are  particularly  simple  and  concise, 

ard  indicate  the  functional  dependence  on  tho  spectra,  coopeotrum 

and  quadrature  spectrua.  Spectral  representation  fomulcc 

for  the  variances  and  covariances  of  the  »  On  »  Ql,  »  Q»  » 

.1  ^l  '1  I 

'1»1.,2,  X  are  possible.  However,  If  the  a  »  * 

Q.  ,  l^ltZ,...,!  are  replaced  by  certain  modified  forms  &  , 

Om  Vlj 


^l  '’l 


tho  spectral  representation  formu¬ 


lae  {3*23)  still  hold,  end  the  spectral  representation  formulae 

for  tho  variances  and  covarlauiceo  are  particularly  simple. 

The  modified  forms  ^  ,  Q  »  $.  »  1"1»2,  I,  are 

^1  ^l  ^1 

studied  below  and  the  spectral  representation  formulae  for 
the  varlanoes  and  co /ai-lances  of  those  forms  derived. 


•  VS' 


■j." 


ii-  ■  i 

.1 


. 


It  shoald  bd  montlonod  that  only  the  aaaomptlon  uf  weak 
ntatlonarlty  was  uaod  to  derive  the  expectation  foin.ulaa 
( 3-23 ) ».  whui  uua  In  tho  uorlvatloh  of  the  spectre!  repreenn U-' 

A  A  A.  . 

tlon  of  tho  varlanooa  and  oovarloncea  of  tho  »  On  »  * 

Q.  ,  l=‘l,2,  , , , ,  1  the  aasumption  that  (3*2)  lo  a  sample 

■..®l  ■  ■  ■. 

from  a  Clausal  an  prooeaa  la  uaod4  The  Qauaslon  assumption  la 
used  to  express  fourth  moments  in  term*;  of  second  moments  by 
means  of  the  theorem  of  Isserlla  which  stales  that  If  i  ^ 

Zyt  8j^,  have  a  Joint  Oausatsui  distribution  with  zero  moan*. 


(  ■3.29  )  Cov(  Zj^Z2|Z2Z[^)=Cov{  Zj  z^)Cov(  Z2Zj^)+Cov(  z^z^)Cov(  ZgZ^^ 
where 

(3*30)  Cov(u,v)«Er(u-Eu)(v-Bv)]*  £(uv)-(Eu)(Ev). 

The  theorem  of  Isserlls  is  proved  as  follows:  Tho  character¬ 
istic  function  of  tho  Joint  distribution  of  z  ,z.4Z.>z,  ,  Is 
by  (2.7) 


,3.31,  ,.l  11  2  3  J  3  .  .xp  .5 


Where  E  z^^z^  «  m.a  = 
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“  -  --»  *>*«•*  4  !!  w  T  ■  ’  .4  '  »  Si  ,  *  ..  » 


y 


•  ••  *•  ■  .  *■  **  ’  N. 


.  •  ■■  V  V  .•  .•  .-1 


•  *«  •  •  •  •.  *  *4 

•e  •  •  •  »  »  ',*•  *  •  •  ■  *  .■ 

a  •  •  "•.k  *  •  *,’♦**%•  *  •  *  '**■,*  ■  • 


!  -w" i,* 


■»  MM  I  III  4.4^ 

VV"- 

V' 

r,.', 


■  '  ■  ■> 
■  ■ 


•  W  •*  .4  . 


Vi  •-*4  *.  * 


Upon  oquttlnij  tha  ceefficl^nta  of  In  the  expansloni 

of  tha  right  and  left  hand  nanbars  of  (3. 31)  on®  obtain* 

(3.32)  E(*^*2‘3*li^  ">12‘*"3U  ^  V2ll  *  ^U‘^23* 

But,  . 

(3.33)  “  E(e^R2*3‘l4.>  "  ^^*1*2^  *3*4^ 

.  "  E<V2VU^"‘‘12‘^:V^13‘^24^‘‘iU‘*23 

=Cov(  j)Cov[  S2i^)'K:ovt  tj^ij^)Co»(  *2*  j) 

la  Introducing  tha  Q„  ,  0^,  >  •  Q.  *  1=1, 2,.,., I 

^1  ^1  ^1  .  °l  • 

and  In  deriving  spectral  represenvatlcn  forsiulaa  for  the  varl 
ancea  and  covariances  of  these  forma  It  la  convenient  to  rcalfa 
the  following  change  of  notation.  K  translation  of  time  le 
made  ao  that  time  zero  occurs  at  the  center  of  the  record;  so 
that  (aaaumlng  N  to  be  odd)  the  finite  sample  (3«2)  la  then 
denoted  by 

(3«34-)  ^  ^  ~i(N-l),  0,1,  •••»  i(N-l), 

^  A.  A. 

The  feme  A.  #  D,  are  then  defined  as  followst 

n  a  n  a 


(3.26.1)  Q-  *  2  S»» 

®l  h“0  . 


►  V  V  •«■ 
a' •-■-'■V. 


^  X-2M-1  (.A.. 

0.36.2),  Q^^i  - Jo  V 


^  X-2M-1 

S  “h-o 


^  K-2M-1 

(306U^)  <ia^  -  \v 


WSv;:i:S 


It  Is  dsslrsd  to  represent  Cov(A.^»X^),  Cov(  , . . . » 


Cot(D  ,D„)  SB  followst 
s  n 


.  ■  .  •  *  •  u‘-  .  - 

•  ■/  •.•  -•  ' 

.  •  •  .V  ^•.  i*. 


(3.37) 


(sa)  Cov(Xj^,Xj^)  *  /  ^  T.,(X)dA. 

(ab)  ■  /  cos  n\  cos  nV  V^^:x)d\. 

(ac)  CoT(ij_j,G^)  -  /  cos  kX  cos  .-a  V^^(X)dX, 

(ad)  CoT(i  ,D  )  ■/  cos  aX  sin.  kX  V^^(X)dX, 


•  -**  '•  .*  -*•  • 

Pi  r~  WHvrn-irnpM 

;r  s  ;■> 


>> ‘  s-vx-  -: 

.  <  •  ^  M  ■  Jk  •  V  ** 


(bb)  CoyIB  )  ■/  cos  nX  cos  =;-*.  7  ( X)dX, 


•'.  -’. ' 

;  :vS.>>:vS 


-  ^;6  - 


(3.377  oont« 


(be)  Gav((ia,',C^)  ■  S  coa  nX  cea  nX  V^.(X)dX» 
:b»  n  Q  rft  . 

(bd)  Cov((3  .D;,)  “/  cos  mX  sin  nX  V.  .( X)dX, 

ilD  n  OQ 


K'  *  . 

(.00 )  ,C  )  “/  cos  mX  cos  nX  V  {X)dX, 


(cd)  nX  Vp^(X)dX, 


( dd)  Cqv(0  ,D  j  *  /  aln  mX  sin  nX  V..(X)dX, 
•tt  n  Q  .  .  da  ■ 


For,  with  th«  refS'caontatlou  (3.37),  the  covariances 
Cov(Q  ,Q  ),  Cov.((3  ),  Cov(Q  ,Q  ),  ...,■  Cov(Q  ,Q  ), 

tti  dj  “l  7j  Oj 


Gov($^  )  can  b®  'expressed  «fl 

-3 


(aa)  Cov(Q  »  2 

;  '^l  ■  m,n-0  ”  ”,  “  ^ 


N~2M-1  f . \  \  * 

=  Z  Ayuy'  /  cos  bX  cos  nX  V  (X)dX 
m,n-0  ™  ”  o  .  aa  ' 


/  ^(1)  .) 

-•  /  P_  (\)  P;J'(  X)  V^fX)dX  where 

Q  *  ^  a 

P  (  X)  =  Z  a  cos  mX, 
■  ®  in=0 
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’  a,  V  *.  ",  a,  *  *1  •  '  « 

.*•  ■  *  •  .*•  ^*e  _*•  .  S.  ' 


v*';**^  V';'  •> 

» •  w*-  • ' .  • . 

“.•V  v^Xv^■  .•■;  ■ 

•.  .«  •  V  .•  V 

^  /•  N  >  •'-  . 

•  "  -.‘.s'*  S*.'." 


.v'.-.-V-'.- 

.•.‘.vV-V-'w--  J.-. 

H..‘  <  *'  *  *  •».  *  -v*  a  .IT* 


t*Wi  grBr  nr  ^ - 


■> 'Av- :■ 

*"  .•  «**  • 

A-.* 


•  **■  /•  *"•  4*^^ 


^  '  I 

J  -'.  '  • 


:vv  ■■!> 


-  i  iln  MX. 

WO' 


kUpl*|iaalona 


for  Var(^^^),  Var(^^),  Var($g^)  Al*« 


than  obUlnad  from  (308)(«ft),  ( 3.38)(bb).  OO0)(oo),  (  3.36)(  dd) 
raapeotlvaly  by  aattlng  j«l,  Thua,, 

(3.39.1)  Var(l  )  -/  r^U)(x)lV  >x)dX. 

.  .  1  0  *  ** 

(3.3y.2)  Var(QpJ  -/  tP^^^Xll“v^j^CX)dX* 

J,  -  O' 

(3.)9.li)  )  ./  (n)dl. 

Tha  oomputatlona  In  the  darlvatlon  of  the  oovarlanoo  rprmula* 
(3.37)  are  aomowhat  lengthy  and  detailed  and  for  oonvenianoa 
are  aet  apart  In  Seotlon  3.5.  Thooa  oomputatlona  ahow  that 
V^^(X),  V^^(X),  V^^(x),  ,,,  V^j(x>  are  given  byi 


(3.U0) 


8k  ' 


.‘•i'f  S’SV  ' '  ■  ■ 


>  -‘.V. 


■‘S'!  >/vS* 

u-.. 

■  *.  '*  “*0*  v‘*' 


mmmwmm 

,*  •* — ?'“V  ■ 


i.V  V.  e“  V  \*  ‘a* 


•  v-s 

.^S  e  *  *  *  *  •  . 

V  -v  •.  •-  V'  .  • ,• 

.  •  '4  -  .  *  . 

■  '  ^  ^  •.’'  •.*•  /l- 
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'v  *.  *,  ^*i''a''e‘'..ta»ai 

'1“ ’ 

a  V  '•*  *  *'*,•**  •**  •  *  •*^'.*** 

'  e^*  ^ 

■  a  ‘  a  ’’a  **•  '*.  “"v  **•  a* 

- .  N .  --T. Vi'*  ■ 

......  .  .  .*  \"  *,*  •  *  '.y,  *.*  V*  ^ 


(X*  )te(X^X*  )eC  X.X*  )N(X^X*  )q(X-x' )  ]dx’ , 


4* 
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X 
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• 

1 

X 

> 

• 

> 
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■  o 
J> 

'X 


i 
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A 
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X 
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X 

A 
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■ 

X  • 


2 


/> 


(3.U4)  3^  ■  2;//i|j50»l(k- J  Xj_+X2) 

+  'co«{(k-J  )(Xj^'«-X2)'*‘t^»“t‘lvXj^-X2)  1 
•*  oo8((k-J  )(Xj^-X2)-i{K-*'n)(  Xj^+\2)  1 


*  •  • 

s'.s' 


+  0  03  t(k- J  )  (  X2^+X2 1  ! '  '-.v 


Let 


X-  iCXj^-Xg) 

(3.U5)  or 


X^  “  X  ♦  X 


X  “  i(Xj^+X2) 

Th'j«, 

(3.46)  dX^dXg  ■ 


“  -  X+  X 


d\ 

ax^ 

b\ 

bXg 

SXg 

dx 

Xg  <  « 

dXdX*'  -  2dXdx' 


c'ortns  into  tL  s  yogi  on  R 


of  Fig.  (1). 


Plg.(l) 
.  bU.  - 


W'^ — 

A 


■  •*  m*  \ 


»•  -e* 
_e  •* 


.  >\‘- 

Sv 


«  : 


n 


.  '"a  ■**•  ^  M 


:-v^ 

.**  .'An 


/*  xN 


.  .  e  . 


Thua*;. 

(3.U?)  3j^  • /j^l[]co3l2(k-j  H+vn-n)  x'l  ♦  coa[2(k-J  )X  ■♦■(ic-n)Xl 

+  oo*r2(k-J )X-(m+n)X  1 

♦  costZCk-JjX  “( m*ii  )X||  g^(  X-*- X  )g2{X-X  }dXlX  , 

By  expanding  the  ooa  I  ]  terms  In  (3»U’7)  *nd  noting  that 

t.irtt3  Involving  8ln2{k-J)Xor  «ln2(k-J )  X*  vanish  on  sunnatlon, 

t3.i;8)  3j^  “  /j^l[eo32{k-J)XcC'a(m-n)X^  cos2(k- j  ) X^cosCm-n ) X 

’  .  *■  co32(k-J  )Xca5(Ri+n)X 

♦  co32(k-J}x’co3(iu+n)x]gj^(X+X*  )g2(X»X*  )dXdX  , 

But,  ■  ■ 

H  r  M  21(k-j)X, 

(3,49).  j  0O32(k-3)X  -  Bottl  Pard  S  e 
J,k--M  ‘•j,k»-M 

‘  r  **  21kX  H  -21JX-, 

“  Real  Part  (  2  •  )(  2  e  )| 

k=-H 

.  (SlniiMnVXj*  ^  (2Hn)nK^.^.(X), 
where  X^(X)  denotes  the  Fejer  kernel. 

Thus,  by  perfornlng  the  au-Tjr.atlon  In  (3*li3)  »ud  using  13.U3.1) 
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(3oO)  Sj  “  2«(2M+l)/j^tK2^^j^(X)cos  aX*  coa  nX* 

•f  K2}^^(^*)c3*  CO*  nXlgj(X+x' )g2(X- X*  )<lx<S\' , 


Which  raduces  to  (3.U2.1)  whan  ona  conaldara  tho  sTraraal. 
tha  region  Hi  and  that  g^  and  *r6  even  functiona* 


of 


Case  82 ‘ 

E7  the  sane  argument  aa  for  cat#  3^^  abora 

(3*51)  Sg  ■ /R/’IcoaEdt-J  )Xcoa(8i-n)X*  ♦  oo82(k- j )  \* coolm-n)X 

-  00B2(k-J  )XcoaCieen)X* 

-  oo32(k-J)X  co8(a>n)Xlg^i  X-^  X 'g^lX-X*  )d>dX  • 
By  pirforralng  the  summation  In  (3*51^  and  using  (3.43.2) 

(3.52)  32  “  2x(2M+l)/j,/(K2y+j^{X;3ln  aX*  sin  nX* 

*  K2>j^^(X*  )3ln  nX  ala  nX)gj(  X+x' )g2(  X-x' )dxdx' , 

which  reduces  to  (3.42.2). 

Case  a. 


By  using  (3.43.3) 
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"’A 

'<  .••  .*•  --S'. 

--S'. 


If  .,.^4 


'  -  •  - '  •  >  •  •  • 

!-•  V/A  • 


4': 


‘  \ 
*  X 


'  •/ 


iy->'w’<V-\v/- ■  ■,'■ -I- 

*  '•**^**\*^  . '«*  *, 


(3*53)  flj  •• 


i.V»,  _■•.  _•■> 


♦  slrt  C(k-J )  (Xg+Xj^  )-i( m-n)(  J 


■♦•  Jiln  Uk-J  )(  X2-Xj^  )+Jt(m*'n)(X2+Xj^)  J 


By  uslr;g  tha  tranMformatlon 


+  3lnl(k-J)(X2+Xi)  +  i(m^n){X2-X^)l]c(Xi)h(X2)'i^idX2; 
nfiformatlon  (3«lv5) 

r  .  .  /  :  A- VA 


(3*54)  “ /j^r|^ain(2(k-J  )X+(m-iilx' 1+  alnt  2(  k- J  )x' +tm-n )  X 1  • 


-  ain I2(k-J )X-( m+n )X 


slnli2(k-J)  X*  -( m^n )  >.  )jg(  X+X*  )h(  -  X+  x'  )dMx' , 


^■.  '.  A--’.- A- •■.  A^'.  -'  •■ 

■■.  .  .  '.'•■.•■VA'-V- 


By  eK-paddlng  tba  alnl  Itarnis  In  {3.54)  and  noting  that  terms 


Invclylng  sin  r;(k-J)X  or  aln  2{k-J)X  vanish  on  auimnatlon* 


(3.55)  5^  “ /jj/Ztcos^^k-j)  X  8ln(m-n)x'-co3  2(k-J)X'  3l[i(m-n)X 


-  C03  2(k“.l)X  3ln(m+n)X* 


'v<A’A^.'=7:a*^v’ 

•.■  •  '  'V.  '•  ,N\s.  .*•  j,'.  -■• 

.  ■’  ■  , 

,*«  \*  .V*.  V  .  V*  • 


+  coa  2(k-J)X*  8in(m+n)X)g(  X+X*  )h(X-x' )dXdX*  . 


Thua,  by  perTormlng  the  summation  in  (3.55)  a>^<l  using  (3.43.3)i 


(  ,1.56)  Sj  =  2it(2M+l)/j^/‘ {-K2{j+.j^(  X)cos  mX*  aln  nX 


'  \  v», 

■.*  V  ■>  ‘  •  ^4** 

.  '  a-  «'*  V  •  •  •  a  *  . 

V‘.  ■»  vS  '  \  s  •  ’  ‘  •  *'  ■ 


+  x')co3  mXaln  nXlg{X+X  )h(X-X  )dXdX. 


■  ,  • .  •  .  ■  u  «  -'•  .  •  .  •  /•  .  •  . 


-\v  ••-.•v.'  •-•  •.' 
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S.  •  ^ 

'  v‘  •  '  • 

‘'.  •*•  A  • 

•  • 

*  .  »  .  •r,  li  .  » 


P  ''4WA 
.4«sW 


Ond  obtain®  (3i4ii* 3)  from  (3«56)  bj  considering  the  region  R 
and  using  the  fact  that  g  la  evan  and  h  la  odd. 

Caae 

By  using  (3.43.2), 

(3.57)  S,^  “  V/i[io8t(k-J)(X^-X2)H(m-n)(X^4-X2)J 

-  008 f I k- J ) { 

■*•  oo8f(k-J)(x^-X2)~i(m*n)(X2‘*X2)l 

-  co8({k-J)(Xj^+X2)-i(m+n)(Xj^  •X2)]]hi(  Xj^)h2(X2)dXj^dX2. 
By  using  tha  transformation  (3.45) 

(3.59)  3^_  ■ /j/s[*oo8|:2(k-J)x+(ia-n)x’  j+  008l2(k-J  )x’+(m-n)X ) 

-  ooB(2(k-J)x-(n+n)x’j 

+  oo8[2(k-j)x'-(«+n)x)jh^(X  +  x')h2(X-X*)dXdx'. 

3y  expanding  the  cost  1  terms  and  noting  that  terms  Involving 
8ln  2{k-J)X  or  sin  .2(k-J)X  vanish  on  summation 

(3.59)  ■ /jj/lt-eos  2(k-J)X  co5(a-n)x'+co8  2(k- J  )X' co8(in-n)X 

-  cos  2(k-J)X  ccs(ro+n)x' 

+  cos  2(k-J)x'cos(m+n)Xlhj^(Xtx')h2(>-X*)dXdx', 


'  •/  'Si\s  ■* 

'  J  •  .  •*  •  4 

>  V  •>  V  •  V  '  . 


v'-.vv 

!  /-  .%  .  .*•  A 


»■  :-  4.  ^  ^  ■  g  .  *  .  «  .  .  , 


5  V  s  -A  -A  -  V  "^a 

^ A'-  '.a  '  W  •  X  ’  \  '  , 


-  -  ‘  v  *  .  - 

■  -.1  -.1  -v-  <-.V~ 

K-*’  *y<.«  At/*'* 


S  V 


(X2)d>j^dX2 


i  t  / 


k- J  -i(  m+n)  1  Xj^slnlk- j+ic  Bitn }  1  kgj 


♦n)JX3^*inrk 


.(k)  K  (k) 

(3.92.3)  K  (X)  -  X  cw  CO*  Xb, 

h-0  “ 

*tk)  m  (k) 

(3.92.?;)  2.  {X)-I  <1h  tin  Xh,  (k  -  1,2.  , . . ,  I ) 

.  ■  >“0  ' 

*nd  n  «  K-2H>1.  Tha  p.'Oblem  of  how  to  choosa  tha  filter* 

Jk)  ^(k) 

(?n  (x)»  2^  (X)  )  ao  that  "good*  a^tlr-stcra  for  the 

Cjj  I  k=l. 2, ara  obtained  is  now  diacuaaed. 

This  diacuaaion  la  reatrlcted  to  the  case  where  the  frequency 
dor.aln  0  <  X<  x  la  partitioned  into  *  aet  of  froqueney  Intar- 
vala  1  Xj^,  k  «  1.2....,I  by  tha  partition  0  ■  X^  •<  Xj^  < 

. . .  <  <  Xj.  »  X  given  by  0  <  ^  <  3  ^  <  . . .  <  ( Ztr.-} )  ^  <  . 

(2r.-l)  5—  <  X  *0  that  I  ■  »♦!  and  tha  frequency  Intervola  *r« 
(except  for  the  tvo  end  intervals)  of  equal  length.  One  can 
consider  the  m+l  frequency  Interval*  to  b*  centered  at 
0,  2  ....  (b-1)  2*  *  respectively.  Ccnslder  the  trlg- 

oncnetrls  ama 
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t3«98.l)  th«  (for  «*12)  Is  of  thj  form  skstohsd  In 
2}  »na  vith  v3«'93.e}  fill«t‘  (for  m-lZ)  is  of  Uto  fovu 
hsd  In  F1«4(1).  It  is  saan  that  t..a  first  flltar  nosrly 


+  KoJ?jj(-^)+kJi,+i(X)1. 

SlmHarly, 

13.100)  itReal  Part  ^Q^X-kJ)-  Vo(X*kJll  - 

4  Real  P.\rt  [  X)*K(j  f>jj(X  )+K^  ) 

I 

■(  X ) +Ko^jj{  X)  ♦Ki/^  ^ 

whar« 

(3,101)  ^^(X)  a  Real  Par  t(  <^j^(  X)-  k  «  1,2... ..m-1 


-  Real  part  I  ^ 
n 


•c> 


1' " 

»  Imaginary  P&rt  t  - 


1  ^  sla 

m  J=-n*l 


ain  J\ 


2%  ^oln  aln  J\. 
S  J-1  “  .  . 


Thn  flltara  centerad  atX"  0  and \*  x  (l.e,  oaaaa 
raqulro  apeolal  treatnent<  Thus, 


(3.103)  Real  Part  ^q(X-x) -Real  Part(Kj^^_j^(X-s)^KQ  <fQ(x-x)4K^  ^j^CX-k)I 
“  i  Ko?l  *  ‘  "8^®*^"  approxinatloa  to  tha  Idaal 

3inc«  tha  quadrature  apactral  danalty 

q(V, )  la  on  odd  function,  q(0)  ■  q(x)  “  0,  Thua,  If  m  la  auffl» 
olantly  largoiona  nay  trJce  ••  0,  For  asallar 

B  tha  detaralnatlon  of  a  "good*  approximation  to  tha  ideal 

and  would  require  a  atudy  almllar  to  the  one 

oarriad  out  by  Tukey  (17  1  to  datemlne  a  "good"  approximation 
to  the  ideal  P^^^l  )  and  la  here  omitted. 

3.7  Sampling  Diatrlbutlon  of  the  Katlreatora 


In  3octlona3,3,  3.!l«  and  3.5  the  mean  valuta  and  varl- 

anooa  end  covarlancaa  of  tha  eatlmatora  Q  ,Q.  ,  i.^l.P,...,! 

'll  Yl  flj 

were  studied,  k  heuristic  discussion  of  the  diatrlbutlon  of 

the  estimators  Q  ,0.,  «Q.  ,  I  “  1,2,. ..,1  Is  now  prosontod. 

®1  ‘‘l  '<^1  ®1 

The  analogue  of  the  spectral  representation  (2.33)  for 
a  discrete  parameter  two-dimensional  stationary  vector  process 

la 


(3.121)  4,  «  SiTI  / 

■  •sn/  (X)dZy(X)  ♦  dZ^(K)dZy(X)I 

-  ^i,^^X)l(dUjj(X))dUy(X;)4(dVjj(X))(d/y(X))I. 


A  similar  argument  for  Q.  yields^ 

®1  ■ 


(3.122) 


A  #»  — 5— /^i^^(\)((do^(M)(dv^(x))-(dv  r\))(dD^(X))l  . 

®i  2(2Hn)  0  **  *  T  *  y 

The  expressions  (3. 116)3(3. 117)»(3.121)|(3*122)  should  bs 

regi'.rded  as  seymptotlc  forms  of  $  .Q.  respectively. 

*^1  *^1  '1  °l 

Frca  those  expressions  one  c'csorve.n  tho  following: 

(a)  If  tho  filters  P^^^(X),  P^^^X),  P^^Nx),  P^^^X), 

1  ■  1i23  ...I  I  had  an  Ideally  sharp  cut-off  (l.e,  vanished 
outald*  the  Intarvels  X^^^  <  X  ;<  V^,  -X^  i  1  .2  ”^1-1^*  then 

for  1  y 

GeussliU'  case)  bs  Independent,  since  each  estimator  Indexed 
by  1  and  each  Indexed  by  J  are  functions  of  spectral  random 
verlabloi  In  disjoint  frequency  Intervale,  and  such  random 
variables  (In  the  Gaussian  case)  are  Independent,  Thus,  If 
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th^s  (X),  •««.  (\)  hftifd  m  r^asonAbly  aharp  out** 

off  (this  Is  attslnsbls  IT  (2M'«'l)  Is  lsrt;s)  ths  sSClm^tors 

^  ••••*  ^  /  J  spprojcltrstsly  Inda. 

®l  ®  1  °  J 


pendant  fop  large 

(b)  If  the  filters  \\) ,  ...,  were  Ideal  and 

the  fraqueney  Interval  ^  aufflolently  narrow  so  that 

f»(Xj,f  (X),o(\),q(X)  could  be  considered  constant  In  the  Interval, 
than 

0.123.1)  «  K  ((dtr^(X))*4.  (dV  (X)*l 

0.123.2)  Qp^  rt  K  /  ^  ((dUyCX))*  ♦  (dVy(x:')*) 

0.123.3)  K  K  f  (cH/^(X))(dDy(X))  +  ( dV^(  X  > )  ( dV^  (  X) )  ) 

^l-l 

A  X, 

(3.123.0  Qa  »  K  ((dU^(X))(dV  (X))  -  (dV  (X))(dU  (X))), 

^  X.  .  ^  ^ 


thus  •••»  would  (In  the  Caussion  case)  bo  respectively 

suras  of  Infinitely  many  Independent  Indentlcally  distributed 
random  variables,  end  hence  by  the  central  Unit  theorem 

would  be  distributed  four-varlete  Gaussian. 

Thus,  if  the  filters  P<iJ(X) . pJ^’(X),  are  reasonably 

flat,  have  a  reasonably  sharp  cuUoff,  and  are  not  too  wide, 
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•  A 

■  •  aV. 

,*  •.*  ./ 

-s  .S  , 

\u  It  •~‘^  I  i*  »%>t+4^  bB  ,>M 


(3..125) 


loop 

0  1  -p  a 

a  -P  1  0 

p  a  0  1 


,  (£i*+p*  <  1), 


for  fixed  1,  end  {'*xl''^xl''*yl*^yt^*  ^  *••*  ^  Inde¬ 

pendent,  One  then  approxlmatoa  the  Joint  dlatrlbutlon  of 


(3.1261  [ 


5., 


,  ~x  » 


‘1 


Ve  q,  e 


•  .  ^  1 
*  !■&  Q  Ed-  J 


by  the  Joint  distribution  of  (a,b,o,d).  In  roforonca  to  (3.124), 
one  naturally  ossoclatoa  (^xl''^xi'^yl'^yi^  with 


(3.127) 


dU^(X^)  dV^(X^)  dU^(X^)  dV^(X^) 


/fy(x^)d\  yry(x^)dx 


so  that  the  paramotera  a,P  In  (3.12$)  are  Identified  as 


(3.128)  a  =•  -—^25^==  ,  P  “  -j==^L== 

Jcj\)tA\)  JcA\)c(\) 


*,  •«  *.  »  „  w  « 
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'*• 

•  *. 

*•  **  .*«  i  a  • 

.'A  w 

»..AV  '  VA'i  -.lA 
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•  •  n  •  »  '  V,  *  . 
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Th«  condition  a*+P*  <  1  which  Ineuroo  th«?t  v  Is  poaltlv#  e«ml> 
deflnlta  1*  tViA  nnnlogn*  of  the  cohorency  condition  (2i[J2>2) 
that  o"(x)  ♦  q*Cx)  -  T^{\)  f^tx)  1  <>• 

'.?h«  Joint  dlptrlbutlon  of  (ft,b,o,d)  and  rolated  distri¬ 
butions  sra  studied  In  Chapter  U.*  As  indicated  In  the  prs- 
oedlng  discussion  (  and  later  dlaousaod  in  Chapter  5)  these 
distributions  approxlmaLe  the  Joint  distribution  of  the 
relatlTO  or  dinonslonlees  estimators  {3*126)  and  the  dlstrl- 
butlone  of  certain  functions  of  these  estimators. 
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Chtptar  U 

Tne  Coffiplax  Wlahart  Distribution  Aiid  Ralabad  nlatrlbutloni 

U , 0  Introduction 

.  This  chapter  concerns  Itself  with  the  deriva¬ 

tion  of  ‘■he  dletrlbutlons  of  certain  functions  of  caaplax 
Oauaslan  randOni  variables.  The  fundamental  distribution 
derlvsd  is  a  eomple.':  analogue  of  a  Wlshart  distribution. 
This  distribution,  named  the  Complex  Wlshart  distribution, 
serves  as  the  starting  point  In  the  derivation  of  t2:a 
other  distributions, 

li ,  1  Introductory  Spaeiric - •• » on  of  the  Complex  Wta>,5.rt 

Distribution  and  He!  'Distributions. 

Lot  X  and  Y  dei..  ^e  the  complex  Gaussian 

random  variables 


(U.l) 


X  -  U,  ^  1  V, 


Y  -  Uy  +  1  Vy  , 


where  the  real  random  variables  T7  ,  V  ,  U  ,  V  era  dla. 

3v  A  y  7 

trlbuted  four-varlatc  Gaussian  with  moan  (0,0,0,0j  and 
varlanco-covarlanco  matrix  V 
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For  Indopandsnc  real  blvarlata  Gtueelan  rar.don  vtrlablas 

(Xj.Yj),  such  that  E(Xj,Yjl  »  (0,01,  the  joint 

distribution  of 

n  n  n 

(!i.7)  XX*  X  Y*  ,  2  X.Y 

J=>1  J  J-l  J-1  J  J 

Is  e  Wlahart  distribution.  Thus,  (h.6)  su^sests  that  the 
Joint  distribution  of  A,B,C  I  D  Is  a  cortplox  analogue  of 
a  Itlshart  distribution.  .  The  Joint  distribution  of  (A,B,C,D) 

Is  therofors  called  a  Complex  Wlshf.rt  distribution. 

Kow,  in  direct  analogy  with  (U.U)  define  ar.i  evaluate 

1  a 

(U.8.1)  C  a  Sp.rpla  Co-Variance  of  X  with  Y  =  Heal  Part  (~  X  xT  Y.) 

^"j=»l  ■>  J 

■  A  • 

(U.8.2)  D  3  Sample  Quad-Varlanco  of  X  with  Y  3  Inag.Part  (-^  X  X*Y  ) 

.  ^"j=l  ^  J 

s.  2  (.V  ,U  ,  +  0  ,V  .)  , 

*j  yj  Aj  yj  * 

a 

{U.8.3)  R  a  Sample  Amplitude  of  Crjss-Variar.o e  of  X  with  Y 
=  Amp  £  X^Y.)  =*  VC*  +  0*  . 


(U.3.U) 


‘J=l  J 


3  Sample  Artni:.:ent  of  Cross-Variance  of  -X  with  Y 
a  Arg  Z  (C  ♦  I  D)  , 
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P  B  flampla  Varlanod  Hatio  of  'i  and  X  4  -i  , 

I  X^X 


I  2  XjYjl 

(!i.3.6)  Z  2  Samnla  Coheranoy  of  X  and  Y  3  - — ■■  -  —  • 

(  2  X^'X,)(2  Y^Y.) 
J=1  J  J  J«1  J  J 

“  A3  >  • 


(U.8.7)  L  2  Sampla  Complex  Reproaalon  Coofflcletit  of  Y  on  X 
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2  X%. 

,  irlJLl 

2  X*X, 

J  J 


C  +  ID 


The  s«inr)le  cc.-nplax  rogreaelon  coofflclent  of  Y  on  X  can 
be  oxpreeoed  In  various  coordinate  aystems.  Tho  following 
coordinate  syatema  (aee  Plg.(U)l  are  of  Importance! 

(li.9.1)  Rectar.frular  whore  L  =•  1  , 

{U.9.2)  Polar  (0,^)  where  L  3  0  e^  , 

1  4>a 

(U.9.3)  Radial-Transverse  where  L  =  1  L^)e 

(U.9.!i)  Cantored  Polar  (L^.Q)  whore  L  a  (1  1*0  • 
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Fig.  (Ii).  Coordlnata  ayotawa  for  tha  aaiqple  complex  regression 
coeffiolent  of  Y  on  X. 

The  point  7  designates  the  oomplex  regression  coeffiolent 
of  Y  on  X. 

The  point  Pj  deslgnattJ  the  sample  oomplex  regression 
ooeffloient  of  T  on  X, 
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WfiieeaJiillih^ 


Oo3f.'*la Iwnt  of  Y  on  X 


0  ■  ArgilL-Lg)- Arg  ( (^  * 


Xn  th«  romalnlng  atotlona  of  thla  ohaptar  tha  dla* 
trlbutlon  funotlona  of  tha  random  variablaa  deflnad  by  (I1.6) 
(U>d)f  and  aa  well  aa  many  joint  dlatrlbutlona  of 

thaaa  random  variablaa  ara  dorlved*  An  Index  of  theae  dla> 
tributlona  la  given  In  Tabla  t,  i  , 

U.2  Dlmonalonleafl  Random  Vorlablea, 

In  deriving  tha  distribution  funotlona  Hated  In 
Table  I  It  la  convenient  to  v'orU  with  dimanolonleaa  or 
relative  random  variablaa.  Thus,  define  and  evaluate 


n,.  V,, 

‘j  -  “  “5;  *  ^  •  "xj 


+  l  V. 


(U.12) 


The  real  random  varleblea  ’’xj*'  '*yj»  ^yj 

are  distributed  four-varlate  Oauaelan  with  moan  (0,0, 0,0) 
and  varlance-oovarlanoe  matrix  v  where 
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TABLE  r  (eontlnu4dl 


Joint  Distribution  of 


Probability  Danalt 
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(o)  If  ^(0)  d«r  *^.*5  th*  oharaeterlstlo 
fur.otlon  of  th«  random  vi»r<alil4  X,  than 

E  /-  S  -  f*{k0i 

whara  k  danotas  a  constant,  is  tha  eharac terlstlo  funotlon 
of  the  distribution  of  tha  random  variables  kX, 

li , It  Patermlnjitton  of  tha  Charactorlstia  Function  of  the 
Unit  Complex  Wlshart  l>.» atrlbutlon 

Consider 

defined  by 

(U.22) 
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.  . .  •* 


n 


’ll 


=  £  T" , 

J=1  • 


where  specified  In  (It. 12).  Thus, 

'’11*^12*  *•"  *  ^Ult  distributed^  with  a  Wlshart  distri¬ 
bution  and  the  characteristic  function  of  this  Wlshart 
distribution  la 

n  n 

(U.23)  ^  (0^j)  =  -  1  , 


Soa  Chapter  XI  of  tl9]. 
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wh«r« 

II  1  II  1  2  If  1-J 

(U.2U)  ilv^i  ■*  V-  .  "  I  If  1/j 

and  V  la  given  by  (It. 13). 

^  computation  ahowa  that 

(It. 25)  |v|=>  6“=  (1  -Y*)  *  where  Y*a  a“  +  p*  and  63  1  -Y* 

and  that  (when  0  <  6 ) 

1  0  -a  -p  ; 

0  1  p  i 

-a  p  1  0 

-p  •  -a  0  I 

From  tho  charao terlatlo  function 

Wlahart  distribution  the  characteristic  function  of  the 
Joint  distribution  of  (a,b,c,d)  la  obtained  aa  I’ollowai 
By  applying  property  (b)  of  Section  It.  3,  tho  characterlatlo 
function  of  the  transformed  variables 
(U.27) 
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Lat  (whan  d  >  0) 


(u.n> 


■  n 

e^a  -  2n  . 
V  -  2n  0^  . 


Thua,  from  (L.26)  and  (Ij.^O)  n 


(1-10^> 

0 

(-0-l»g> 

(-p-io;) 

<h  (Q  io»,t0«.0al  »  a 

ft  ^ 

r  a’  b*  e*  a 

0 

(1-19J 

(-a.l«;) 

(P+ie^J 

(i.i®;) 

0 

(-p-10^) 

(-a-io^) 

0 

(i.ie;) 

(U,32) 

t  * 

,  a  -n 

-  6"(( 

i.i0;)(i- 

10^)-  (a+ic 

Ig)  -(pi-10 

d’  ) 

From  (!},?2)  It  Is  aaslly  verified  that  the  mean  and  var3an0a> 
covariance  ratrl;^  of  the  Joint  distribution  of  (a,b,c,d)  ara 
respectively 
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in.  . 


.N. 

A 


L«t  (vtaa  a  >  0) 


(U.3S) 


«  a  «  n  • 

to*  a  •  n  to 

Q  a  2n  4 

d  a  a  2n  d 


■6  th*t  th#  charActerlfltle  i'anfitlon  th*  Joint  distribution 

•  111 

of  tt«to,e.d  1* 


a  -Oi 


(1*.’6)  ®  C:i-19‘)(l-i9*)-Ca  +  10j)  -(p^iol)  3  . 


•  f  t  I 

Slncd.  a,b,c,d  ara  proportional  to  a,b,c,d  raspectlvalT, 
tha  charactarlstlc  function  of  ths  Unit  Ccriplex  Wlshart  dis¬ 
tribution  can  ba  conslderad  as  given  by  (U.36), 
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Ij.S  raterrir.atlon  of  t'r.s  Probability  l^snslty  Funetlon  of  ' 
■  '?>■»'  Tr.l  t  Gorrclax'"'  Vif'oArV'bl  s'criDU  '  ■  ' 

Tna  probability  darslty  function  p(a|b)o)d*)  of  tha 

»  t  f  I  1 

Joint  distribution  f  (aftoiOid  )  is  now  darlvad.  Tha 
Foorlar  trinsfom  forrulta  used  In  this  derivation  (and  In 
tha  darlvatlons  that  follr-'}  ara  llatal  In  Tabla  II  at  tha 
end  of  this  chaptar. 
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Tha  notation  ejtployed  Iz  this  section  ar.4  In  subsoquent 
sections  deer  not  distlr.relsh  between  rar.don  variables  and 
the  variables  In  the  prcbabllttj  density  runctlon  for  the 
rando.z  vtriables.  Such  a  notation  very  slzply  identifies  tha 
randc.z  variables  with  thilr  probability  density  fuiic tlc.ns , 
and  since  rany  (see  Table  Z',  pr-babllity  density  Ainctlons 
are  derlvsi,  such  ease  of  1  lentlfica tlo.u  is  Izpcrcant.  Kad 
it  been  pcsslble,  rar.dcn  variables  would  have  been  printed 
In  boldface  type;  however  avsn  though  this  r-as  rot  been  done 
It  is  usually  clear  fro.t  the  context  which  variables  are 
randon  rariabies. 
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Sxpor.ir.tlal  Fourier  transforms  oi."  'iho  typo  listed  in  Table  21, 
l.n  cns  or  several  variables,  are)  3'l(sply  denoted  by  T,  so 
that  for  example  equation  (li.37))  Ha  written  as 

(u.35)  p(t.'b;c!d')  =  T  • 

Fi’cao  (4.‘»3),(l4.36),  and  Table  rt  ((4)  . 
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id, 6  n-.^  OnU  Oompld.r  Vlahart  Dlatt*ibul]on  J  i)  th't  Parfoo^vly 

Cch<r»nt  Cp.iw 

Th*  Unit  CompJ.ox  Wldihurt  distribution  In  th«  psrfsotly 
oohsront  oasxi,  i.s,  in  tho  osa*  wh»n  Y*  <■  I  rsqulrst 
speolal  dlacuaalon.  In  tbs  porfeocl^  oohsront  oaas 

a  ■  ooa  ^0  »  "  •1*'  ^0 

SO  thst  ths  Tsrlanoa-oovarlsno*  matrix  v  of  th*  four- 
Tarlats  Ctuasitn  randoa  varlabls  bsoomssi 
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^  ualng  th«  ratio  toatt  and  tha  a.iynototlo  formula  for  tho 
Oanuna  i^inctlon  r(x)  w^2w'a“*x*"^  one  verifies  that  th* 
series  ia  (U.^$)  oonver^ea  for  [  ys  ooa(^  **  ^0^  <  1  • 

1«.7.3 

rron  (U,$5)  and  t2:a  definition  of  the  incomplete  beta 
function  (see  Table  III  il)  at  end  of  chapter) 


(U.56J  /  p(E/^)ds 
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00 

Z  "  ' 


Trr  (n)  r  c=-l)  k-o  r(k+l) 


B^i{^l,n-l)ooe^(^  -  ^q)  • 


By  dafloltlon  of  the  beta  function  f see  Table  III  (2)) 

1,  V  r(|+i)  r(n-l) 

(U.57)  lln  B  .(^l,n-I).B(9  4.1,n-l)- — .S'  -  , 

x-->l  *l  ,  r  (j+n) 

Thus, , 

a.«,  p<6 ,  -  . 

Trr(n}arO  f  (k+1)  ° 

The  sarlee  In  (U.58)  CG=,rergae  for  |  Y  co8{^-^q)|  <  1« 
r  ya'.b!  g) 

Bj  Integrating  Clii.S2)  on  (f)  (aes  Table  lit  (1)) 
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Thui,  by  Integrating  (U.61)  ca  ■  tie*  Teble  III  (5)1 

,u.«)  p-.M <» .  jiL  t 

Trr{n)  k>i>Q  kir(n+j) 


U.7.7  ■ 

ProB  (U.12) 


(U.65)  -  <^(d^,0,0,0)  -  (1  -io.)' 


Thui,  by  Table  II  (U) 


(U.6tt) 


p(al  -  T  (1- 


iA^)-n  ■  a-! - 2 -  for  a  >  0 


r  (n) 


•  0 


for  a  <  0  . 


Thua,  2na  la  dlatrlbutad  l.«.  with  probability  danalty 


function 
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■  •  S'  sv*  ■•  '•  ''V*  / 

.  -V****  '*•  '  •  '  ■ '  ■  '/  •/  • 

*■'/  V.*V. 


:£I 


•.*  •  .*•  .*•  ■■  .‘•'Z*  aS’ 

«  •*  '/  *  ’  ‘  '  •  *  •  •  i  • 


■'*  W*'  .*■  ,*•’  «**  •** 

>^x:’v-^x-;v>:-:v:v:v:v 


•'s''* V.' -  •' 

'>  v''  -*-V-‘.-wV.' 

*  •  *  <*-**  «  *  a  ^  k  '  .  "  «  a  « 

k  •  »  •  a  •  a  • S  ‘W  *.  **  *. 

*  a  a’-  *"*- 

ki^9 


(U.U'i),  by  Integrating  on 


frem  (U.17.3)  snd  (li.35) 


(Ji.79)  o'  **  2**g  ooa  P  »  ^  ■  Sa'g  sin  <f>  , 


T^ius,  (tt.yH) 


(U.20)  p(slg,^)  .  exp  [-a*Il-2Yii  c<^3( 

nr(n)  .  . 

Ths  coadltlan  y*'*  !■  Insures  that  tl-2Yg  coa(p  - 
f-r  a  <  p  <  2Tr  ,  0  <  g  <  oo  « 

Ftt?!  (Ii.30)j  b»  Intagratlng  on  a*rso«  Tabla  III  (7)  J 


,  Prom  (ii. 17. 17.2), 16.4) 
f*‘.90)  -  «  .  Jtx„  -  S  »tn^  . 

Thu«,  rrotn  (4,3l) 

‘^*7.21 

By  Intagratlng  or.  In  (ij.^l)  (see  Teble  III  (SJJ 

(4.92)  p(jPpJ  u  - 

By  Integracing  on  m  (4.91)  Isoo  Tablo  HI  (3)) 


(‘“93)  p(.?.  ) 


*.  " 


.tv.  a  I _ , 

^  '  XJtt 

li.7.25  p(k) 

In  ()».8l)  let 

(!i.9!4)  u  =  tan  (^^9)  ■ 

•o  that 

(4.99)  C03(  •)  -  i  )  -  ^--^-  ,  d(6  -  6  1  a  2du._  , 

1*U'  /  ‘^0'  Uu* 

and  therefore 
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■  V"- 

(t.96r  p(8l  -  ^  /  P(ff, 

■* 


T _ ks..  - - 

0  ttt(i-?i  ■<.+;=Yg+g*)u*J"^^ 


Thua,  taaa  Tabla  III  (9)J 


k-O  r(kfl)r{n-k*l)  l+2Yg4-g* 


»i.7.26  w(  <6  ) 

Cat  ' 


(1i.93)  a  -  -Y  oos(p.p^)  . 


Than,  (U«8l)  can  be  expressed  In  the  for« 
(li.99)  P(g,^) 


ng*!s- 


n+l 


iril-a%(g-.-ar] 

n0*^(g-*-8)  nO^s 

Trtl-8»^lg>s)»r^^  "  trU-a’'Ms+a)»)"*V  ’ 


Thus, 

(It. 100)  plj)  )  -  /  p(etj>  )<i« 


00 


2rt  0  ir'l-a*+(g>s)*l"  ^ 


nO^s 


How  let 

(It.lOl)  g+a  -  (1-s*)^  ten  r  . 
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V.  .1.  .  ^ 


k-o  f  (iiir(rt»i)(ki)* 


Tbui  bf  InttgrAtlni;  aa  n*  In  ()itl06) 


11.7.29  ULf) 

Pron  (U.107)  b7  Integrating  on  ct  Tabl*  III(i?)  !' 

(k.io5)  p(rl  .  ?  - 

k«o  r  {n)r(kfi)r(k^n' 


Bj  \i3tns  tbo  ratio  test  one  eatabllwhaa  that  the  aorles  tm 

(!{.103)  aonYerges  for  - -  <  •—  j  l.a.  for  0  <  f  <  oo  JLT, 

liY*  ,  . 

Y*  <  I  . 


b.7.30  p(uVb*) 

ProM  (11.59)  by  integrating  on  alsee  Table.  Ill  (2)11 

-f 


CI».lf'?)  p(a,'b’) 


r(B) 


00 

2 

Ir-rO 


y2kt,<^»,ken.I 

r  (k4.i)r(k+n) 


Proa  Table  IIX  (11) 

(ti.no)  p{alb’)  -  ..^-^..1 

.  ■  ■  ,  Y 

Prum  (li.7U)  by  Integrating  on  d'isee  Table  III  (I])))! 


* )-•••' -b'  rT~Y 

■— :lg -  I  (.?y/i»  b  J  . 

n-lp(^)  n-1 


-1)1; 


frort  FIs*  ( 5)  (U»o9) 


14*120  Prob.  (1^- <  a  ^  ,  !h-vI  ^  ) 

>  Prob*  ( )  -  l-ri*a“^(Al)*J  ”  . 


whers  ■  Y  • 


A  sttC  S  or  similar  Inoquali ties  oan  te  c'wtained  by  er>» 


closing  the  clrcule-  region  of  Fig*  (5>  la  other  regions. 
Thus  (see  square  region  of  Fig*  (5))» 


(4.121)  Prob*  (IJ?R*-oiI  <  *  ^L':  *  i'" 


PurthertbOiOa  . 


(4.122)  Prob.  (Set  of  Tnequalltles  S)  >  l-(  7  . 
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'VX.'’.'" 


'i* 


I- . -M: 


e  ,  e  I, 

.v.'by.v.'.sv-'.vy.y 


Hf- 


■■’X"  V’" 

•V'Vv-- 


,'  Si"  -.*  S"  S.’  -."■s'  '.•  -.■  S 
■■  .* 

.■  Si*"  '>w"  *.■  •-*  V."  Si 

••  .“>■ 


(5)  ;  /  (u-«)”  du  -  r{n+l)  •* 


Thla  definition  of  the  Incomplete  bets,  function  Is  the  one 
given  In  (UI.  In  mathematicsl  statistics  it  Is  customary  to 
refer  to  the  function  s  p,q)/Bj^(p,q)  as  the 

Incomplete  beta  function! 


TABtt£  III  (continued) 


1(11) 

Modlflad  Boaaal  funotlon  of  the  kind  ’ 

1 

oo  . 1  .2k+n-l 

■  2  - - 

"  *  Ic-o  kl  r(k+n) 

(12) 

Modified  Basael  function  of  the  third  kind 

Kj «)  -  5  - y — 

^  .  aln  v  n 

and 

K  (a)  ■  lira  K  (s)  for  integer  n  • 

V — ■>n  '' 

K  (a)  -  h  "2^ 

"  a-C 

+(-)  .  Z  ^  -j" — ;•  [log(iz)-J ’'j/(ra-fl)-i^ 

TO^O  al(n+m}l 

:wh«r«  .  ■  "  ■ 

•  -Y  (v  denotss  Sular'e  oonataftt  0.5772157  ...) 


y  ( a>l )  "*  y  ^  2  ^  * 

•  •  •  0  ^ 

n 

-Y  • 

■■ 

.  fn 

-  b* 

lltH 

(*  »  0)  , 

* 

m 

-OJ 

a 

n;*l 

(lii.) 

^00,-px  ,n-2  ^Tpc 

0 

■  *n 

(Rt  a  >  0) 
( Ro  p  >  0) 


itupllQatlont 


g.O  Irtroduotlon 

In  this  ohsptar  it  is  shovm  how  ths  rssults  of  ths 
prsvlouB  ohsptsi's  miij  bs  ussd  to  dtsouss  ths  sampling  vsrl* 
ability  of  satlmatora  for  ths  spectral,  coopaobrAl,  and 
Quadrature  spectral  densities  of  a  two-dimensional  atatlon- 
ary  (aero  mean)  deunslsui  vector  procass.  The  response  of  a 
linear  time  invariant  nystem  to  random  inputs  is  studied^  and 
it  Is  shown  how  certain  functions  of  the  speotral,  oospeotral» 
and  quadrature  spectral  danoltlaa  of  measured  input-output 
records  are  related  to  the  frequenoy  response  function  of  the 
system,  extraneous  Inputs  to  the  ayetam,  and  errors  in  mea¬ 
suring  input  and  output; .  It  . is  then  indicated  how  the  sampling 
variability  of  ostlmstors  for  thene  fvinotlons  osn  bs  discussed 
by  means  of  the  results  of  Chaptsr  4* 

The  Joli\t  DlsPrlbution  of  Eutimatoro  for  tbe  Spectral. 

Co'upect'ral ,  '  nnd  CcuadForturb  Spootral  benaitles. 

At  v.he  end  of  Section  3*7  it  was  indicated  that  .the 
Joint  distribution  of  (a,b,a,d)  approprlsts  psramstsrs 

approxlmatss  ths  Joint  distribution  rf  the  relative  or 
dlnenslonlaaa  •stlmatara  for  the  spectra,  jospeotrvm,  and  ■ 
quadrature  spoctrum 


-  la,/  > 


'■  •v  .•  •  V. 


‘l  •  4*'  0* '  •  *  » 


4...  jf  '*  '!  '  j 

' '  ' 

■  '  ■  \  A  .Vv’-V.V 


,v.  -'.v. 


V  V  •-*  v, 


-■.a. 


“<  **•  »*»  •  ^ 


i 


tf 

I 


( ■ 
'( 

•i 


,1 

■]■■ 


1 


>  ■  W 1 1  *  I  >«  I  A***ri**M  ni  -^'  ^---i,-  ,.ii^%#i 


(S.ll 


3. 


"^1 


“^a,’  /(E5„^KE<lj) 


In  Chapter  U  th#  probability  danslty  function  of  th*  Joint 
distribution  of  (s,b,Otd)  and  ths  probability  danslty  functions 
of  many  rslatad  distributions  w«r«  derived.  In  order  to  apply 
these  results  to  the  Joint  distribution  of  estimators  for  the 
speotra,  oospeotrurs,  and  quadrataro  spectrun  it  is  nsoasaary 
to  dstarmtne  the  paranstera  a,P,n»  A.  dlsoussion  on  how  tha 
parameters  Ojpjn  can  be  detarmlnod  Is  pi'usor.Leu  uwlo'.f.  . 

On  the  assumption  that  (5*1)  1»  dlatrlbubed  as  la 
(a.b.o.d)  l.e,  with  a  Unit  Complsx  Wlshart  distribution  It 
follows  from  (403)  that 

(S.2>  .  ■■!  .. ««  a,  — “  P  * 


^  V»\Vs*A‘'’  a'-  ‘ 


ad  *  - -  ■'  -  -*" 

2  ) 


Fro.-n  (3.1;0)  cn  ch«  ftaaunptlcn  that  2M+1  la 


•uTflclehtly  larfi. 


SO  thst  th#  FsJiV  kdz*nAl  k  /  ^  ^ 

jar  Karnal  )  acta  affact'Tely  aa  a  Calta 

function  canterod  at  X* “0 


[5.U 


•»  ,•»  . 


( aa ) 

V<''  “  JiiJi 

!  ab ) 

V^jj(X)  P* 

tc"(X)+q«(>))^ 

ao ) 

\c^\)  ^ 

8k 

t.n'rl 

VX)C(X), 

ad] 

en 

2=1^ 

bb] 

flTt 

■^TfT 

fyU). 

»c ) 

8n 

2R?T 

^y{>-)0(X), 

d) 

Vbd(X)  »=« 

Sa 

2?Fr 

fy(\)q(X), 

=  ) 

Lit 

SFITT 

rr^(x)fy(xJ>o»(x)- 

u  ’  *  ,•  *, 

'N 


.‘w  ‘,*1 


I -,  .::3' 


fc  ;  ■  .  »  4  V 


n 


4 

I 


r..  4.  - 


( 5>4)  oontlnutd 


(cd)  ^  c(XktX). 


(dd)  Vdd^'*^  tf,U)r^{x)+q“(x)-c*(x)l, 


Thup,  from  (3*23)  (3.38)  cn  cssiimptlcr.  f^vX/* 

fy{  X),  c(X) ,  q(x  )  &ra  apprcxlriteir  constant  ov«r  th#  widths 
of  the  flltara 


(5.5.1)  a  S  »  2  f-(X^^^)  /  ^[^Nx)dx, 

“1  *  0  * 


(5.5.2)  S  » 


2f^(x‘-'J/  P^-Mx)dX, 


(5.5.3)  E  S  »  ?  c(X^^^)  /  ?' 

0  ® 


id) 


(X)dX, 


(5.5.4.)  E  M  2q(X^^h/  ^[^\x}d\. 


and 

{S,h) 


(aa)  VRr(^^  )  «  f*'!  x' *  ^  '  P;^  ^(X  )  )*di. 

1  0 


.bb 


I 


'■✓‘vJ/J'vj 


-'•.>»  •  W  • 


r;"  '.  '"  •'v! 


•-\nV.\'-’. 

.•  *  >.■  V 


■  •  ••  •  1 
‘/'.s' '-'3 


-.V 

>  .S'.sy.  , 


'  /. 
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n  :  1/ 


U  .. ..  '.-i 

•wWl  ftMi  Ukftl Utaiklt 


iL*f  I  '  I  •:  • 
^  }j  ^  .»  4* 

<_*  «.  « ,*  . 


iS.b)  oontlnuBfti 


(ab)  Cov(l  ^ 

1  ^  '  0 
tao)  f^(X^  ^  ^  )o(X^  ^  ^  i  /  ^(X  ^  X),dX4 


(  ad  )  C  ov ( :«  f^(  V  ^  ^  ^ q(x  ^  ^  ^  ^  X  ) '  (  X)  d  X, 

(bb)  Ver(0p^)?^^3^fy(X^^^)/(P^^^(X)  )*dX, 

(bo)  Cov(i(j^.O.^  fy{X^^^o(X^^^)  /pj,^\x)^<^^X)dX, 

(b.l)  Cy(\^^hq(\^^h  /Pi^^X)^i^NxidX. 

(co)  Var(i^^)f=^l^^  r^(\<^^fy(xt^^)+o"(X^^^) 

-  q"(X^^^'l/"  (P^^^X)  )"dx, 


(cd)  Cov(il^^,Qg  c(X^^^q(X^M/’'  ^  X)Pj^  ^(  X)dX, 


•".  •'.  •’.  * 

.  •  • 


^  H  • 


Co-/-. 

V.-.\'.  ^ 
.'  V  .■ 

fc.  *-  *.  • 


s'*-  s'  " 
*.**’•/** 


%  •• 


i; 


.A>‘ 


-  V\ . '  '''■ 

Alik  Ml. 


'4^  H€»kil> 


‘.‘.■;.'.%v..‘..'^ 


,  ,  , .  , 

;■*»  '  ‘i  *4  "1  .•. 

n4iftykija»)iktaAiu.i*~^  t  7  1  -  i4-i- 


I  ,*.  ,'.,*< .  <  I  ‘ . 

"v! 

I  .'■  >"“  i‘*  v'*  •'•  « 
i'/ 


(5'.^)  oontlnuAd 


(del) 


i‘  (X^  ^  ^  )t‘  ( X^  ^  ^ )  +q*(  x^  ^  ‘  ) 


.•(x">)]/  >V 


wh«r«  X^^^  dinotii  th«  fraquanoj  «t  whloli  tho  flltari 
P^V^(X).  &r«  nantarad* 

Equatlona  (5«2)>  (5<3)»  (5>U}*  15»$)  And  (5>^)  Indioata  how  th« 
paranatara  a«P«n  oan  ba  datarmlnad.  From  ($»Z)  and  (5«5) 


(5.7) 


h 


.gCx.^l!.! 


f^(  x^^^)fy(x<^^) 


If  aufflolant  a  prloxl  Inf ormutlon  about  f  (X),  f„(x)»  o(v)» 

*  y 

q(x}  la  availabla  It  may  bo  posuibla  to  datermlna  a«p  from 
(5.7).  Suoh  Information  will  rarely  bo  avnllebla,  howover, 
It  la  thus  au^geated  that  a,p  be  taken  re "peo tl vely  aa 


(5.6) 


“XT'  "“7TT' 


^  Di.H  ^ 


I  ,  a  W  »  .'a  .  •  •.  •  W. 

*  '  a  ^  ■  *  *  • .  * 

-‘i-' . 't 
■/ 

X/v  :  >■ 


»* . 

.*  V  ‘ 

"  a  •  A  *  a  '*ja  »  ' 

-  •  j.  •  .  •  .  •  a  ■  »  ^ 

%/  .,•  a,*  «, 

%  ■  .»  •  t  •  i  *  \ 

'/  \  •  ‘•'b 
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•  •.  ‘  .*  -V-  v'- 

a  nV  a 

<  r  i  •  - 

It'  >^||‘****^W 

y**/'*, - 

'  *»  N  *»  .'•  a**  a* 

v'w*?  •.  -•-  A  . 


Vi-.M 


'■v.m#.V.O-.'.£rti!.| 

irr;« — ^-w-y^ 


.-  ■.' v.v. 

■ 

!■.■  *:ni, '■■ti'.® 

-%■  - 1-;  »  .  I  ,  »  *  w  ■ 

•/  •'.*  •w* 

.  ■>:.v.->  .■’■ 

•  .  •  a  •  a^  4  •  li 

v*. V 


*'•  -*'.e  ■ 


l«i«.  that  OfS  b«  taken  ea  oqual  to  tholr  aainple  veluea. 

If  tho  Ideal  flltere  given  by  (3i<:t4.)  and  (3.26)  wvm 
attainable,  then  froA  each  of  the  ten  oaaea  of  ($.3)  ualng 
(5*5)  end  (^.6)  It  would  follow  that 


■  *X  "X«  ) 

(5.9)  2n  »%s — (a+l) 


For  the  polynomial  flltere  of  Seotion  3»b  (where  Kq  and  Xj_ 

are  defined)  It  aan  be  ehown  that  for  n  aixf flolently  large 

00  that  ~  le  auall  oosipared  to  ~  . 

.  m* 


-  ^  a  •„«  \ 

'  *.  *.  %  *% 
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C*;-! 

.■■■ 

.-•  ■•'msn'ijctl 
s^S."  V  .  vX  ' 


*K.  S 

*  ^  a  V 
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,  -  k  •  Vw 
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Cv'^'Cv;-;v:v;' 


(S.io.l)  /  r^.  ^  {K^^  *  2Kj^J  "  25  » 


>»,■».  I  y..»  .■'» 


(5.10.2)  /  ^l^hx)  (xj 


u,v  «  a,b,o,d}  1  •  Z  ,  'i,  •  •  t  ,n-2. 


Thua,  from  each  of  the  ten  caeea  of  (5*3)  using  (5*5)  and  (5.6) 


(5.11) 


2n^  ^  ^  « 


X*  ♦  2X'  m 


.  */-  •  “  •  v\- 

■vAv:-.-:'.-;--:; 

a  "  a  T  a. 

'  ^  ►  -  '  K  -  •V."  -J"  ■ 

.  ■  N  V  S 


for  i  *  2^3#***#^**^* 


TVia  asaixmptlona  on  which  (^•11 )  waa  obtained  are 

(1)  the  densltlea  ^‘y(X>,  c(x),  q(x)  are  approxlpiately 

oonatant  over  the  wldtha  of  the  niters « 

{2)  2M^1  la  surriclently,  large  that  the  PejAr  kernel 
Xo«A-i<X*)  A«ta  erfeotivaly  e«  a  Oelta  function  ocntoied  at  X  -0, 

(3)  m  aufflolently  large  (—  nraall  compared  to  g  )* 

m* 

That  oondti^lon  (l)  above  la  aatlafled  can  often  be  eatabllahed 
from  a  priori  knowledga  of  fjj(X),  fyCX),  ctX),  q(X)t  Thua^  when 
the  oondltions  (1),  (2)«  (3)  *^***  aatlafled  and  the  filters  of 
Section  3.6  are  uaed«  It  la  auggested  that  n  be  determined  from 
(5.11).  When  condition  (1)  la  not  satlafled,  the  do turml^iotlou 
of  an  appropriate  n  to  use  In  the  Complex  Wlahart  distribution 
becomaa  difficult.  If  condition  Cl)  la  not  too  flagrantly  vio¬ 
lated  It  la  ooggeated  that  ”ab^*  •••»  computed 

from  (50)  using  (3.23).  (3.39).  O.UO)  and  that  bo  taken 

aa  the  irilnlmum  of  the  ••*.  *^dd^  determined. 

When  the  danaltLoa  f^^Cx),  fy(X),  c(x).  q(x)  vary  greatly  over 

the  wldtha  of  the  filters,  the  uao  of  the  Complox  'Wlahart  dla- 

trlbutlon  Is  no  longer  Justified  bv  the  argument  of  Section  3.7. 

In  such  oases  It  may  bn  poaalble  (from  a  priori  knowledge  of 

f  (X),  f  (X),  c(X),  q(X),  to  tranc.orm  into  txj^.y^jl 

X  y 

by  a  linear  tranaf ormo tlon  or  the  form 


v  V  •/-i 


V  -c 
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whero  K(ic)  d«notes  the  impulse  response  rune tl on  of  the  system 
•nd.  L  deaotes  the  linear  operator  expressed  on  the  right  hand 

aide  of  (5.13r._ 

The  expor. e^: rri al e  are  olgenfuncticns  of  the  operator  L 

and 

(5.1l|.)  i.  e^'*^  -  JJ(\)e^'‘^, 
vhere 

(5.15)  j?(\)  5  u(X)  lv(x)  -/  K(r)e‘-^‘'(i3:. 

■  •  •  •  ^  ’ 

The  fxinctlcn  J^(X)  Is  called  the  freq-usncT  response  f’onctlon 

or  the  transfer  function  of  the  aysteir  Z.  and  characterljee 
the  system,,,  Prom  (5.1m-)  one  observes  that  .^(X)  essentially 
gives  the  output  of  the  system  L  to  a  sinusoidal  Input  of 
frequency  X.  A  simple  computation  shows  -that  . 

(5.16)  I.  sin  Xt  =*  u(X)3lnXt  v{x)cos  xt'  =  V^^+v*  sln[  t+^(X)  ] 

where  X)  =  (  X )  +  v ^ (  x )  . 


Also,  b  V  "  =  '.<  1  nn 
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X{x)  * and  Y(X)  =«  .  y ( x) 

-  00 

Th«  determination  of  the  frequency  response  function  J^(X) 
of  a  system  la  of  considerable  practical  interest;,  Kuch  atton— 
tlon  has  b>a8n  devoted  to  the  problem  of  experimentally  dGt6r~ 
mining  the  frequency  response  ftinctlon  of  a  system  and  several 
»"^thods  have  been  employed.  The  methods  customarily  employed 
differ  essentially  In  the  choice  of  whe  input  excitation  used. 

The  elassloal  method  is.  suggested  by  (5.16).  If  the  system 
L  Is  subjected  to  a  sinusoidal  Input  of  frequency  X,  the  . 
resultant  output  la  also  sinusoidal  of  frequency  X  but  possibly 
of  different  amplitude  and  phase.  The  amplitude  Vu*(X)+v*( X) 
and  phase  ^(X)  determine  ^(X),  Thus,  the  value  of  the  frequency 
response  function  ^(X)  at  frequericyXls  determined  by  measuring 
the  amplitude  and  phase  of  the  output  which  results  from  a  sin- 
\asoldal  input  of  frequency  X,  The  function  ^{\)  Is  explored 
by  lotting  X  vary  through  a  sot  of  frequencies  •••* 

A  second  method  is  suggested  by  (5.11)  and  (5.15),  If 
the  system  L  Is  subj^c^ed  to  a  unit-impulse  input  (l.e.  Ideally 
x(t/  =  lit)  where  denotes  the  Dirac  delta  function  )  then 

as  la  33~n  from  (5.13)  the  output  Is  y(t)  =  K(t).  Thus,  If 
the  output  resulting  from  a  unit -Impulse  Input  la  measxired,  the 
freq'ter..'.  /  ■: -itpor.to  function  ?('x)  la  calculated  by  using  (5,15). 

Availsbl©  Copy 


A  third  nethod  {v;hlch  includes  the  first  two  as  special 
cases)  Is  suggested  by  (5»17)*  If  y(t)  denotes  the  output 
resulting  fres  an  arbitrary  input  xlt)  tfo*  which  a  Fo'urier 
transform,  exists}  then  the  freQuency  response  function. 

Is  calculated  by  using  {5«17i  provided  that  X(X}  /  0» 

In  the  preceding  discussion  of  the  three  methods  no  men¬ 
tion  Is  made  of  difficulties  that  may  be  encountered  in  . 
attempting  to  employ  the  methods.  Such  difficulties  are:  . 

(1)  difficulties  in  exciting  the  system  by  the 
desired  Input  or.  inputs 

(2)  existence  of  extrsineous  t.tlse  inputs  to  the  . 

(5.18)'  system  which  are  not  measured. 

(3)  errors  in  meas'iring  the  input  and  output 

(ii)  computational  difficulties. 

In  the  applications  of  the  methods  discussed  above  con¬ 
sideration  la  usually  directed  to  difficulties  (5»l8.1)  and 
(S’lS.li)  and  the  particular  method  employed  in  a  given  sit¬ 
uation  reflects  the  results  of  such  consideration.  When  the 
errors  and  extraaAflUAjiolsB  are  small, difficulties  (5.^3, 2) 
and  (5»15,3)  are  ignored,  but  when  the  errors  and  oxcraneous 
noise  are  no  longer  sensibly  negligible  the  methods  become 
Inapplicable  as  no  means  of  eliminating  cr  assessing  the  effec 
of  Th.r*  f"-;'cr3  ar.ci  er. troneoui  n'lse  on  '...v  ■ _ freputno'* 
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th*  frequ«ncy  raapoaso  funotlon  whlcii  In  certain  cases  circum¬ 
vents,  these  difficulties  to  some  de/;rx«>e  is  suggested  by  Y.W.Lee 
in  t9l«  The  method  essentially  InvoU'ves  subjecting  the  system. 

I»  to  a  random  noise  input* measuring;  tihe  Input  and  output,  and 
from  the  measured  input-output  recorUl  '".deterDilnlng“  the  input 
spectral  density  and  the . cross-spec truO.  density  between  Input 
and  output*.  Under  suitable,  assumptions  (input  measured  without 
error,  input  Incoherent  with  extraneous  noise), the  ratio  of  the 
cross-spectral  density  to  the  input.  av>octral  density  gives  the 
frequency  response  function  of  the  a;3p:*cm.  Lee  (  9  1  essentially 
assumes  that  the  covariance  functions  omd  spectral  densities 
required  to  determine  the  frequency  rtcnponno  function  are  known 
exactly  (or  equivalently  that  an  Infinite  sample  record  is  avail 
able)*  A  quantitative  basis  for  applying  the  method  with  only 
a  finite  sample  record  of  input  and  output  and  when  errors  in 
the  r.eacured  Input  exist  Is  not  provldlod.  Such  a  quantitative 
basis  can  be  provided  by  recognizing  ttho  problem  as  one  of  the 
Joint  estlnatlon  of  the  spectral,  cQt5;;>ec tral  and  quadrature- 
spectral  densities  of  a  certain  two  dimensional  stationary 
Oaussir.n  vector  process  and  utilizing  the  results  of  Chapters 
3  and  I;  which  deal  with  the  statl'jtlc.ul  estimation  of  functions 
of  these  densities.  A  dlscutsion  of  “.he  statistical  estimation 
of  the  frequency  response  function  cT  a  linear  tl.mo -invariant 
syste.-c  is  now  presented. 
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It  la  olear  from  (5.21)  and  (5.22)  that  th<e  funotlona 
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Intoraat  In  otudylng  the  noises  and  r.ho  system;  L.  Theaa 
functions  can  be  estimated  from  a  finite  part  cf  the  raea- 
surod  I  Input,  output)  record  (  x*(  t) ,  y<*(t).l  a.:  d  the  sampling 
variability  of  the  eatlmatora  discussed  by  moa-'s  of  the  dis¬ 
tributions  gl^ven  In  Chapter  !{..  More  precisely ^vnat  can  be 
oallmated  are  not  the  functions  tf.emse^ vdt>,  c.t  corresponding 


fui\ctlons  of  tvoragea  of  th#  danaltJaa  ^xx*  ^yy*  .®*  ^ 

th*  av«r*saa  ar#  auch  aa  t-  s-^icantrata  moat  of  thalr  weight 
In  narrow  frequency  bande >  31van  below  In  Table  IV  la  a  Hat 
of  the  functlona  to  be  eatlr'«.eu  iln  the  aenae  Juat  dlacuaaed) 
and  the  eatlrcatora  for  thoaa  fxinctlona.  The  Cor.plex -Wlehart 
distribution  and  related  dli  > ,  *;>*ut*  .ua  derived  la  Chapter  U 
give  the  dlatributlona  of  the  eatimatora.  The  dlatrlbutlona 
which  are  relevant  to  dlacuaalng  the  variability  of  a  given 
eatlnator  are  Indicated  In  the  column  of  a  Table  IV» 

The  reaulta  of  Section  4*8  ^^e  uaed  to  pla-i  experiments 

to  "measure"  the  frequency  roaponee  function.  To  facilitate 
such  use  the  functions 


(5.23) 


arc  oln  C  3^ 


were  computed  for  various  values  of  the  arguments  Y*,P,m,N' 
and  listed  In  Table  V.  From  Sections  3.6,  3.7/  and  5.1* 

(5.24)  . 

’l  ,  <l££2Ei2_iiiiL<  1  ♦  3ind^ 

True  gain 

Prob.  ,  ^  ^ 

-ip  ^(Sample  pha3e)-tTruo  phase)  <  ty 

In  (5.24).  and  sin  4  are  given  by  (5«23).  where 
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Purtherraorw,  in 


Staple  gain  = 
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Sanple  phaae  -  Aa*g($^^ 


where  the  polynoialal  flltere  used  in  computing  the 


given  by  (3. *39)  and  the  polynomial  filters  used  in  computing 


are  given  by  (3.100),  and  in  each  case  (Kq,Kj)  1b  given 

®1 


by  (3.98.1),  With  ?=■  0.75#  y"“0-50*  n»=30,  N'-IOOO  one  hae 
(sea  Table  V>  slnA^  >wo.21,A^  fti  12°,  What  la  achieved  with  a 
record  twice  as  longt  With  P  -  0.75,  Y"=0,f;C,  m-30,  N'=2000; 
elnAi  »  0.15,A^  8°. 
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